1
|
Chapman AF, Störmer VS. Representational structures as a unifying framework for attention. Trends Cogn Sci 2024; 28:416-427. [PMID: 38280837 DOI: 10.1016/j.tics.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 01/04/2024] [Accepted: 01/05/2024] [Indexed: 01/29/2024]
Abstract
Our visual system consciously processes only a subset of the incoming information. Selective attention allows us to prioritize relevant inputs, and can be allocated to features, locations, and objects. Recent advances in feature-based attention suggest that several selection principles are shared across these domains and that many differences between the effects of attention on perceptual processing can be explained by differences in the underlying representational structures. Moving forward, it can thus be useful to assess how attention changes the structure of the representational spaces over which it operates, which include the spatial organization, feature maps, and object-based coding in visual cortex. This will ultimately add to our understanding of how attention changes the flow of visual information processing more broadly.
Collapse
Affiliation(s)
- Angus F Chapman
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA.
| | - Viola S Störmer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
2
|
Gundlach C, Wehle S, Müller MM. Early sensory gain control is dominated by obligatory and global feature-based attention in top-down shifts of combined spatial and feature-based attention. Cereb Cortex 2023; 33:10286-10302. [PMID: 37536059 DOI: 10.1093/cercor/bhad282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/05/2023] Open
Abstract
What are the dynamics of global feature-based and spatial attention, when deployed together? In an attentional shifting experiment, flanked by three control experiments, we investigated neural temporal dynamics of combined attentional shifts. For this purpose, orange- and blue-frequency-tagged spatially overlapping Random Dot Kinematograms were presented in the left and right visual hemifield to elicit continuous steady-state-visual-evoked-potentials. After being initially engaged in a fixation cross task, participants were at some point in time cued to shift attention to one of the Random Dot Kinematograms, to detect and respond to brief coherent motion events, while ignoring all such events in other Random Dot Kinematograms. The analysis of steady-state visual-evoked potentials allowed us to map time courses and dynamics of early sensory-gain modulations by attention. This revealed a time-invariant amplification of the to-be attended color both at the attended and the unattended side, followed by suppression for the to-be-ignored color at attended and unattended sides. Across all experiments, global and obligatory feature-based selection dominated early sensory gain modulations, whereas spatial attention played a minor modulatory role. However, analyses of behavior and neural markers such as alpha-band activity and event-related potentials to target- and distractor-event processing, revealed clear modulations by spatial attention.
Collapse
Affiliation(s)
- Christopher Gundlach
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| | - Sebastian Wehle
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| | - Matthias M Müller
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| |
Collapse
|
3
|
Abstract
Human perceptual learning, experience-induced gains in sensory discrimination, typically yields long-term performance improvements. Recent research revealed long-lasting transfer at the untrained location enabled by feature-based attention (FBA), reminiscent of its global effect (Hung & Carrasco, Scientific Reports, 11(1), 13914, (2021)). Visual Perceptual Learning (VPL) is typically studied while observers maintain fixation, but the role of fixational eye movements is unknown. Microsaccades - the largest of fixational eye movements - provide a continuous, online, physiological measure from the oculomotor system that reveals dynamic processing, which is unavailable from behavioral measures alone. We investigated whether and how microsaccades change after training in an orientation discrimination task. For human observers trained with or without FBA, microsaccade rates were significantly reduced during the response window in both trained and untrained locations and orientations. Critically, consistent with long-term training benefits, this microsaccade-rate reduction persisted over a year. Furthermore, microsaccades were biased toward the target location prior to stimulus onset and were more suppressed for incorrect than correct trials after observers' responses. These findings reveal that fixational eye movements and VPL are tightly coupled and that learning-induced microsaccade changes are long lasting. Thus, microsaccades reflect functional dynamics of the oculomotor system during information encoding, maintenance and readout, and may serve as a reliable long-term physiological correlate in VPL.
Collapse
|
4
|
Jing C, Jin H, Li W, Wu Z, Chen Y, Huang D. Temporal attention affects contrast response function by response gain. Front Hum Neurosci 2023; 16:1020260. [PMID: 36760226 PMCID: PMC9905113 DOI: 10.3389/fnhum.2022.1020260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 12/31/2022] [Indexed: 01/26/2023] Open
Abstract
Orienting attention to a specific point in time has been shown to improve the contrast sensitivity at the attended time point and impair it earlier or later. This phenomenon could be explained by temporal attention increasing the effective contrast of the target presented at the attended time point which leads to changes in contrast psychometric function by contrast gain. Another explanation is that temporal attention multiplicatively amplifies the amplitude of behavioral or neural response to contrast, resulting in alterations in contrast psychometric function by response gain. To explore the underlying mechanism, we adopted a temporal cueing orientation discrimination task using audio pre-cues composed of different frequency components to induce different attentional allocations in the time domain and targets of various contrast intensities to measure contrast psychometric functions. Obtained psychometric functions for contrast sensitivity were fitted for different conditions with discrepant attentional states in time. We found that temporal attention manipulated by cue affected contrast psychometric function by response gain, indicating that multiplying the contrast response of the visual target occurring at the selected point in time by a fixed factor is a crucial way for temporal attention to modulate perceptual processing.
Collapse
Affiliation(s)
- Chengxu Jing
- School of Automation and Electronic Information, Sichuan University of Science and Engineering, Sichuan, China,Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Sichuan, China
| | - Hongyuan Jin
- School of Automation and Electronic Information, Sichuan University of Science and Engineering, Sichuan, China
| | - Wenxia Li
- School of Automation and Electronic Information, Sichuan University of Science and Engineering, Sichuan, China
| | - Zhouhao Wu
- School of Automation and Electronic Information, Sichuan University of Science and Engineering, Sichuan, China
| | - Yao Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Dan Huang
- School of Automation and Electronic Information, Sichuan University of Science and Engineering, Sichuan, China,Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Sichuan, China,*Correspondence: Dan Huang ✉
| |
Collapse
|
5
|
Magnetoencephalography recordings reveal the neural mechanisms of auditory contributions to improved visual detection. Commun Biol 2023; 6:12. [PMID: 36604455 PMCID: PMC9816120 DOI: 10.1038/s42003-022-04335-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 12/01/2022] [Indexed: 01/07/2023] Open
Abstract
Sounds enhance the detection of visual stimuli while concurrently biasing an observer's decisions. To investigate the neural mechanisms that underlie such multisensory interactions, we decoded time-resolved Signal Detection Theory sensitivity and criterion parameters from magneto-encephalographic recordings of participants that performed a visual detection task. We found that sounds improved visual detection sensitivity by enhancing the accumulation and maintenance of perceptual evidence over time. Meanwhile, criterion decoding analyses revealed that sounds induced brain activity patterns that resembled the patterns evoked by an actual visual stimulus. These two complementary mechanisms of audiovisual interplay differed in terms of their automaticity: Whereas the sound-induced enhancement in visual sensitivity depended on participants being actively engaged in a detection task, we found that sounds activated the visual cortex irrespective of task demands, potentially inducing visual illusory percepts. These results challenge the classical assumption that sound-induced increases in false alarms exclusively correspond to decision-level biases.
Collapse
|
6
|
Gundlach C, Forschack N, Müller MM. Global attentional selection of visual features is not associated with selective modulation of posterior alpha-band activity. Psychophysiology 2023:e14244. [PMID: 36594500 DOI: 10.1111/psyp.14244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 12/08/2022] [Accepted: 12/08/2022] [Indexed: 01/04/2023]
Abstract
Attending to a single feature, such as color or motion, leads to global modulation of neural processing associated with the representation of the attended features. Alpha-band modulations are hypothesized to be a marker (and even a mechanism) of the modulation of neural processing. By adopting a previously used attentional shifting paradigm, we examined whether alpha-band dynamics are linked to sustained Feature-Based-Attentional (FBA) selection. For this purpose, we presented task-irrelevant flickering random dot kinematograms (RDKs) in the periphery that either did or did not share the to-be-attended color of centrally presented task-relevant RDKs and should thus be subject to global FBA selection. Steady-state visual evoked potentials (SSVEPs) and alpha-band activity associated with these task-irrelevant RDKs were analyzed to quantify FBA modulation. Overall, the SSVEP results replicated previous findings: relative to a pre-cue baseline, SSVEP amplitudes for peripheral RDKs were significantly enhanced when these RDKs shared the to-be-attended color of the central RDKs and were not modulated when they shared the centrally to-be-ignored color. Nevertheless, there were no differences in alpha-band amplitude modulations between signals recorded contralateral to the RDKs sharing the centrally attended color and RDKs sharing the centrally ignored color. Hence, alpha-band modulations seem not to index the sustained global selection of attended over unattended feature values within the same feature dimension.
Collapse
Affiliation(s)
| | - Norman Forschack
- Experimental Psychology and Methods, Universität Leipzig, Leipzig, Germany
| | - Matthias M Müller
- Experimental Psychology and Methods, Universität Leipzig, Leipzig, Germany
| |
Collapse
|
7
|
Foster JJ, Ling S. Feature-based attention multiplicatively scales the fMRI-BOLD contrast-response function. J Neurosci 2022; 42:JN-RM-0513-22. [PMID: 35868860 PMCID: PMC9464014 DOI: 10.1523/jneurosci.0513-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 07/05/2022] [Accepted: 07/15/2022] [Indexed: 11/21/2022] Open
Abstract
Functional MRI (fMRI) plays a key role in the study of attention. However, there remains a puzzling discrepancy between attention effects measured with fMRI and with electrophysiological methods. While electrophysiological studies find that attention increases sensory gain, amplifying stimulus-evoked neural responses by multiplicatively scaling the contrast-response function (CRF), fMRI appears to be insensitive to these multiplicative effects. Instead, fMRI studies typically find that attention produces an additive baseline shift in the blood-oxygen-level-dependent (BOLD) signal. These findings suggest that attentional effects measured with fMRI reflect top-down inputs to visual cortex, rather than the modulation of sensory gain. If true, this drastically limits what fMRI can tell us about how attention improves sensory coding. Here, we examined whether fMRI is sensitive to multiplicative effects of attention using a feature-based attention paradigm designed to preclude any possible additive effects. We measured BOLD activity evoked by a probe stimulus in one visual hemifield while participants (6 male, 6 female) attended to the probe orientation (attended condition), or to an orthogonal orientation (unattended condition), in the other hemifield. To measure CRFs in visual areas V1-V3, we parametrically varied the contrast of the probe stimulus. In all three areas, feature-based attention increased contrast gain, improving sensitivity by shifting CRFs towards lower contrasts. In V2 and V3, we also found an increase in response gain, an increase in the responsivity of the CRF, that was greatest at inner eccentricities. These results provide clear evidence that the fMRI-BOLD signal is sensitive to multiplicative effects of attention.SIGNIFICANCE STATEMENTFunctional MRI (fMRI) plays a central role in the study of attention because it allows researchers to precisely and non-invasively characterize the effects of attention throughout the brain. Electrophysiological studies have shown that attention increases sensory gain, amplifying stimulus-evoked neural responses. However, a growing body of work suggests that the BOLD signal that is measured with fMRI is not sensitive to these multiplicative effects of attention, calling into question what we can learn from fMRI about how attention improves sensory codes. Here, using a feature-based attention paradigm, we provide evidence that the BOLD signal can pick up multiplicative effects of attention.
Collapse
Affiliation(s)
- Joshua J Foster
- Department of Psychological and Brain Sciences, Boston University, Boston MA, 02215
- Center for Systems Neuroscience, Boston University, Boston MA, 02215
| | - Sam Ling
- Department of Psychological and Brain Sciences, Boston University, Boston MA, 02215
- Center for Systems Neuroscience, Boston University, Boston MA, 02215
| |
Collapse
|
8
|
Dissociable effects of attention and expectation on perceptual sensitivity to action-outcomes. Conscious Cogn 2022; 103:103374. [PMID: 35872405 DOI: 10.1016/j.concog.2022.103374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 02/18/2022] [Accepted: 06/28/2022] [Indexed: 11/23/2022]
Abstract
Self-generated sensations evoke attenuated neural response - physiological attenuation - and is perceived with less intensity - perceptual attenuation. This phenomenon is referred as sensory attenuation and is proposed to reflect the silencing of predicted sensations. The present study aimed to investigate the independent contribution of expectation and attention on sensory attenuation. The expectation associated with the stimulus feature and the focus of attention was manipulated independently by orthogonal cues. We found pronounced sensory attenuation at the unattended location when the stimulus was self-generated (Experiment 1). When the stimulus was externally-generated (Experiment 2), sensory attenuation was observed at the attended location. Sensory attenuation of expected action-outcome was not observed when the attention cue was uninformative (Experiment 3A). The findings corroborate the claim from Bayesian models that attention mediates sensory attenuation. The results also highlight the paradoxes in Bayesian proposals of perception-action interaction.
Collapse
|
9
|
|
10
|
Denison RN, Carrasco M, Heeger DJ. A dynamic normalization model of temporal attention. Nat Hum Behav 2021; 5:1674-1685. [PMID: 34140658 PMCID: PMC8678377 DOI: 10.1038/s41562-021-01129-1] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2020] [Accepted: 04/29/2021] [Indexed: 02/05/2023]
Abstract
Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modelled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.
Collapse
Affiliation(s)
- Rachel N Denison
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - David J Heeger
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
11
|
Gundlach C, Forschack N, Müller MM. Suppression of Unattended Features Is Independent of Task Relevance. Cereb Cortex 2021; 32:2437-2446. [PMID: 34564718 DOI: 10.1093/cercor/bhab351] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 07/15/2021] [Accepted: 08/11/2021] [Indexed: 11/13/2022] Open
Abstract
Feature-based attention serves the separation of relevant from irrelevant features. While global amplification of attended features is coherently described as a key mechanism for feature-based attention, nature and constituting factors of neural suppressive interactions are far less clear. One aspect of global amplification is its flexible modulation by the task relevance of the to-be-attended stimulus. We examined whether suppression is similarly modulated by their respective task relevance or is mandatory for all unattended features. For this purpose, participants saw a display of randomly moving dots with 3 distinct colors and were asked to report brief events of coherent motion for a cued color. Of the 2 unattended colored clouds, one contained distracting motion events while the other was irrelevant and without such motion events throughout the experiment. We used electroencephalography-derived steady-state visual-evoked potentials to investigate early visual processing of the attended, unattended, and irrelevant color under sustained feature-based attention. The analysis revealed a biphasic process with an early amplification of the to-be-attended color followed by suppression of the to-be-ignored color relative to a pre-cue baseline. Importantly, the neural dynamics for the unattended and always irrelevant color were comparable. Suppression is thus a mandatory mechanism affecting all unattended stimuli irrespective of their task relevance.
Collapse
Affiliation(s)
- Christopher Gundlach
- Experimental Psychology and Methods, Universität Leipzig, 04109 Leipzig, Germany
| | - Norman Forschack
- Experimental Psychology and Methods, Universität Leipzig, 04109 Leipzig, Germany
| | - Matthias M Müller
- Experimental Psychology and Methods, Universität Leipzig, 04109 Leipzig, Germany
| |
Collapse
|
12
|
Li HH, Hanning NM, Carrasco M. To look or not to look: dissociating presaccadic and covert spatial attention. Trends Neurosci 2021; 44:669-686. [PMID: 34099240 PMCID: PMC8552810 DOI: 10.1016/j.tins.2021.05.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 04/25/2021] [Accepted: 05/07/2021] [Indexed: 11/23/2022]
Abstract
Attention is a central neural process that enables selective and efficient processing of visual information. Individuals can attend to specific visual information either overtly, by making an eye movement to an object of interest, or covertly, without moving their eyes. We review behavioral, neuropsychological, neurophysiological, and computational evidence of presaccadic attentional modulations that occur while preparing saccadic eye movements, and highlight their differences from those of covert spatial endogenous (voluntary) and exogenous (involuntary) attention. We discuss recent studies and experimental procedures on how these different types of attention impact visual performance, alter appearance, differentially modulate the featural representation of basic visual dimensions (orientation and spatial frequency), engage different neural computations, and recruit partially distinct neural substrates. We conclude that presaccadic attention and covert attention are dissociable.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
| | - Nina M Hanning
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
| |
Collapse
|
13
|
Li HH, Pan J, Carrasco M. Different computations underlie overt presaccadic and covert spatial attention. Nat Hum Behav 2021; 5:1418-1431. [PMID: 33875838 DOI: 10.1038/s41562-021-01099-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Accepted: 03/11/2021] [Indexed: 11/09/2022]
Abstract
Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY, USA. .,Center for Neural Science, New York University, New York, NY, USA.
| | - Jasmine Pan
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA.,Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
14
|
Goldbach HC, Akitake B, Leedy CE, Histed MH. Performance in even a simple perceptual task depends on mouse secondary visual areas. eLife 2021; 10:e62156. [PMID: 33522482 PMCID: PMC7990500 DOI: 10.7554/elife.62156] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2020] [Accepted: 01/29/2021] [Indexed: 12/13/2022] Open
Abstract
Primary visual cortex (V1) in the mouse projects to numerous brain areas, including several secondary visual areas, frontal cortex, and basal ganglia. While it has been demonstrated that optogenetic silencing of V1 strongly impairs visually guided behavior, it is not known which downstream areas are required for visual behaviors. Here we trained mice to perform a contrast-increment change detection task, for which substantial stimulus information is present in V1. Optogenetic silencing of visual responses in secondary visual areas revealed that their activity is required for even this simple visual task. In vivo electrophysiology showed that, although inhibiting secondary visual areas could produce some feedback effects in V1, the principal effect was profound suppression at the location of the optogenetic light. The results show that pathways through secondary visual areas are necessary for even simple visual behaviors.
Collapse
Affiliation(s)
- Hannah C Goldbach
- Unit on Neural Computation and Behavior, National Institute of Mental Health Intramural Program, National Institutes of HealthBethesdaUnited States
| | - Bradley Akitake
- Unit on Neural Computation and Behavior, National Institute of Mental Health Intramural Program, National Institutes of HealthBethesdaUnited States
| | - Caitlin E Leedy
- Unit on Neural Computation and Behavior, National Institute of Mental Health Intramural Program, National Institutes of HealthBethesdaUnited States
| | - Mark H Histed
- Unit on Neural Computation and Behavior, National Institute of Mental Health Intramural Program, National Institutes of HealthBethesdaUnited States
| |
Collapse
|
15
|
Jigo M, Carrasco M. Differential impact of exogenous and endogenous attention on the contrast sensitivity function across eccentricity. J Vis 2020; 20:11. [PMID: 32543651 PMCID: PMC7416906 DOI: 10.1167/jov.20.6.11] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Both exogenous and endogenous covert spatial attention enhance contrast sensitivity, a fundamental measure of visual function that depends substantially on the spatial frequency and eccentricity of a stimulus. Whether and how each type of attention systematically improves contrast sensitivity across spatial frequency and eccentricity are fundamental to our understanding of visual perception. Previous studies have assessed the effects of spatial attention at individual spatial frequencies and, separately, at different eccentricities, but this is the first study to do so parametrically with the same task and observers. Using an orientation discrimination task, we investigated the effect of attention on contrast sensitivity over a wide range of spatial frequencies and eccentricities. Targets were presented alone or among distractors to assess signal enhancement and distractor suppression mechanisms of spatial attention. At each eccentricity, we found that exogenous attention preferentially enhanced spatial frequencies higher than the peak frequency in the baseline condition. In contrast, endogenous attention similarly enhanced a broad range of lower and higher spatial frequencies. The presence or absence of distractors did not alter the pattern of enhancement by each type of attention. Our findings reveal how the two types of covert spatial attention differentially shape how we perceive basic visual dimensions across the visual field.
Collapse
|
16
|
Abstract
Visual attention prioritizes the processing of sensory information at specific spatial locations (spatial attention; SA) or with specific feature values (feature-based attention; FBA). SA is well characterized in terms of behavior, brain activity, and temporal dynamics-for both top-down (endogenous) and bottom-up (exogenous) spatial orienting. FBA has been thoroughly studied in terms of top-down endogenous orienting, but much less is known about the potential of bottom-up exogenous influences of FBA. Here, in four experiments, we adapted a procedure used in two previous studies that reported exogenous FBA effects, with the goal of replicating and expanding on these findings, especially regarding its temporal dynamics. Unlike the two previous studies, we did not find significant effects of exogenous FBA. This was true (1) whether accuracy or RT was prioritized as the main measure, (2) with precues presented peripherally or centrally, (3) with cue-to-stimulus ISIs of varying durations, (4) with four or eight possible target locations, (5) at different meridians, (6) with either brief or long stimulus presentations, (7) and with either fixation contingent or noncontingent stimulus displays. In the last experiment, a postexperiment participant questionnaire indicated that only a small subset of participants, who mistakenly believed the irrelevant color of the precue indicated which stimulus was the target, exhibited benefits for valid exogenous FBA precues. Overall, we conclude that with the protocol used in the studies reporting exogenous FBA, the exogenous stimulus-driven influence of FBA is elusive at best, and that FBA is primarily a top-down, goal-driven process.
Collapse
Affiliation(s)
- Ian Donovan
- Department of Psychology, New York University, New York, NY, USA
| | - Ying Joey Zhou
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA.
- Center for Neural Science, New York University, New York, NY, USA.
| |
Collapse
|
17
|
Competing rhythmic neural representations of orientations during concurrent attention to multiple orientation features. Nat Commun 2019; 10:5264. [PMID: 31748562 PMCID: PMC6868242 DOI: 10.1038/s41467-019-13282-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2019] [Accepted: 10/30/2019] [Indexed: 12/04/2022] Open
Abstract
When a feature is attended, all locations containing this feature are enhanced throughout the visual field. However, how the brain concurrently attends to multiple features remains unknown and cannot be easily deduced from classical attention theories. Here, we recorded human magnetoencephalography signals when subjects concurrently attended to two spatially overlapping orientations. A time-resolved multivariate inverted encoding model was employed to track the ongoing temporal courses of the neural representations of the attended orientations. We show that the two orientation representations alternate with each other and undergo a theta-band (~4 Hz) rhythmic fluctuation over time. Similar temporal profiles are also revealed in the orientation discrimination performance. Computational modeling suggests a tuning competition process between the two neuronal populations that are selectively tuned to one of the attended orientations. Taken together, our findings reveal for the first time a rhythm-based, time-multiplexing neural machinery underlying concurrent multi-feature attention. The neural mechanisms for concurrently attending to multiple features in the visual stimuli are not well understood. Here, the authors show that the neural representations for two overlapping stimulus features alternate with each other at a ~4 Hz rhythm that was also observed in fluctuations in the task performance.
Collapse
|
18
|
Symonds RM, Zhou JW, Cole SL, Brace KM, Sussman ES. Cognitive resources are distributed among the entire auditory landscape in auditory scene analysis. Psychophysiology 2019; 57:e13487. [PMID: 31578762 DOI: 10.1111/psyp.13487] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2018] [Revised: 08/21/2019] [Accepted: 09/04/2019] [Indexed: 01/30/2023]
Abstract
Although attention has been shown to enhance neural representations of selected inputs, the fate of unselected background sounds is still debated. The goal of the current study was to understand how processing resources are distributed among attended and unattended sounds during auditory scene analysis. We used a three-stream paradigm with four acoustic features uniquely defining each sound stream (frequency, envelope shape, spatial location, tone quality). We manipulated task load by having participants perform a difficult auditory task and an easy movie-viewing task with the same set of sounds in separate conditions. The mismatch negativity (MMN) component of event-related brain potentials (ERPs) was measured to evaluate sound processing in both conditions. We found no effect of task demands on unattended sound processing: MMNs were elicited by unattended deviants during both low- and high-load task conditions. A key factor of this result was the use of unique tone feature combinations to distinguish each of the three sound streams, strengthening the segregation of streams. In the auditory task, the P3b component demonstrates a two-stage process of target evaluation. Thus, these results, in conjunction with results of previous studies, suggest that stimulus-driven factors that strengthen stream segregation can free up processing capacity for higher-level analyses. The results illustrate the interactive nature of top-down and stimulus-driven processes in stream formation, supporting a distributive theory of attention that balances the strength of the bottom-up input with perceptual goals in analyzing the auditory scene.
Collapse
Affiliation(s)
- Renee M Symonds
- Department of Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
| | - Juin W Zhou
- Department of Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA.,Department of Biomedical Engineering, Stony Brook University, Stony Brook, New York, USA
| | - Sally L Cole
- Department of Counseling and Clinical Psychology, Teachers College, Columbia University, New York, New York, USA
| | - Kelin M Brace
- Department of Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
| | - Elyse S Sussman
- Department of Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
| |
Collapse
|
19
|
Neuronal Effects of Spatial and Feature Attention Differ Due to Normalization. J Neurosci 2019; 39:5493-5505. [PMID: 31068439 DOI: 10.1523/jneurosci.2106-18.2019] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Revised: 04/28/2019] [Accepted: 04/30/2019] [Indexed: 12/22/2022] Open
Abstract
Although spatial and feature attention have differing effects on neuronal responses in visual cortex, it remains unclear why. Response normalization has been implicated in both types of attention (Carandini and Heeger, 2011), and single-unit studies have demonstrated that the magnitude of spatial attention effects on neuronal responses covaries with the magnitude of normalization effects. However, the relationship between feature attention and normalization remains largely unexplored. We recorded from individual neurons in the middle temporal area of rhesus monkeys using a task that allowed us to isolate the effects of feature attention, spatial attention, and normalization on the responses of each neuron. We found that the magnitudes of neuronal response modulations due to spatial attention and feature attention are correlated; however, whereas modulations due to spatial attention are correlated with normalization strength, those due to feature attention are not. Additionally, spatial attention modulations are stronger with multiple stimuli in the receptive field, whereas feature attention modulations are not. These findings are captured by a model in which spatial and feature attention share common top-down attention signals that nonetheless result in differing sensory neuron response modulations because of a spatially tuned sensory normalization mechanism. This model explains previously reported commonalities and differences between these two types of attention by clarifying the relationship between top-down attention signals and sensory normalization. We conclude that similar top-down signals to visual cortex can have distinct effects on neuronal responses due to distinct interactions with sensory mechanisms.SIGNIFICANCE STATEMENT Subjects use attention to improve their visual perception in several ways, including by attending to a location in space or to a visual feature. Prior studies have found both commonalities and differences between the effects of spatial and feature attention on neuronal responses in visual cortex, although it is unclear what mechanisms could explain this range of effects. Normalization, a computation by which neuronal responses are modified by stimulus context, has been implicated in many neuronal mechanisms throughout the brain. Here we propose that normalization provides a simple explanation for how spatial and feature attention could share common top-down attention signals that still affect sensory neuron responses differently.
Collapse
|
20
|
Grillini A, Renken RJ, Cornelissen FW. Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling. J Cogn Neurosci 2019; 31:1329-1342. [PMID: 30990389 DOI: 10.1162/jocn_a_01412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Two prominent strategies that the human visual system uses to reduce incoming information are spatial integration and selective attention. Whereas spatial integration summarizes and combines information over the visual field, selective attention can single it out for scrutiny. The way in which these well-known mechanisms-with rather opposing effects-interact remains largely unknown. To address this, we had observers perform a gaze-contingent search task that nudged them to deploy either spatial or feature-based attention to maximize performance. We found that, depending on the type of attention employed, visual spatial integration strength changed either in a strong and localized or a more modest and global manner compared with a baseline condition. Population code modeling revealed that a single mechanism can account for both observations: Attention acts beyond the neuronal encoding stage to tune the spatial integration weights of neural populations. Our study shows how attention and integration interact to optimize the information flow through the brain.
Collapse
Affiliation(s)
- Alessandro Grillini
- Department of Ophthalmology, University Medical Center Groningen, University of Groningen, Netherlands
| | - Remco J Renken
- Department of Ophthalmology, University Medical Center Groningen, University of Groningen, Netherlands
| | - Frans W Cornelissen
- Department of Ophthalmology, University Medical Center Groningen, University of Groningen, Netherlands
| |
Collapse
|
21
|
Adamian N, Slaustaite E, Andersen SK. Top-Down Attention Is Limited Within but Not Between Feature Dimensions. J Cogn Neurosci 2019; 31:1173-1183. [PMID: 30794058 DOI: 10.1162/jocn_a_01383] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
In natural vision, processing of spatial and nonspatial features occurs simultaneously; however, the two types of attention in charge of facilitating this processing have distinct mechanisms. Here, we tested the independence of spatial and feature-based attention at different stages of visual processing by examining color-based attentional selection while spatial attention was focused or divided. Human observers attended to one or two of four fields of randomly moving dots presented in both left and right visual hemifields. In the focused attention condition, the target stimulus was defined both by color and location, whereas in the divided attention condition stimuli of the target color had to be attended in both hemifields. Sustained attentional selection was measured by means of steady-state visual evoked potentials elicited by each of the frequency-tagged flickering dot fields. Additionally, target and distractor selection was assessed with ERPs to these stimuli. We found that spatial and color-based attention independently modulated the amplitude of steady-state visual evoked potentials, confirming independent top-down influences on early visual areas. In contrast, P3 amplitudes elicited only by targets and distractors of the attended color were subject to space-based enhancement, suggesting increasing integration of spatial and feature-based selection over the course of perceptual processing.
Collapse
|
22
|
Snyder AC, Yu BM, Smith MA. Distinct population codes for attention in the absence and presence of visual stimulation. Nat Commun 2018; 9:4382. [PMID: 30348942 PMCID: PMC6197235 DOI: 10.1038/s41467-018-06754-5] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Accepted: 09/12/2018] [Indexed: 12/02/2022] Open
Abstract
Visual neurons respond more vigorously to an attended stimulus than an unattended one. How the brain prepares for response gain in anticipation of that stimulus is not well understood. One prominent proposal is that anticipation is characterized by gain-like modulations of spontaneous activity similar to gains in stimulus responses. Here we test an alternative idea: anticipation is characterized by a mixture of both increases and decreases of spontaneous firing rates. Such a strategy would be adaptive as it supports a simple linear scheme for disentangling internal, modulatory signals from external, sensory inputs. We recorded populations of V4 neurons in monkeys performing an attention task, and found that attention states are signaled by different mixtures of neurons across the population in the presence or absence of a stimulus. Our findings support a move from a stimulation-invariant account of anticipation towards a richer view of attentional modulation in a diverse neuronal population. Attention affects stimulus response gain, but its impact without sensory drive is less known. Here, the authors show that attention is coded diversely in a population and is distinct between unstimulated and stimulated contexts, providing a contrast to normalized gain models of attention.
Collapse
Affiliation(s)
- Adam C Snyder
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, 15289, PA, USA.,Department of Ophthalmology, University of Pittsburgh, Pittsburgh, 15213, PA, USA.,Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, 15260, PA, USA
| | - Byron M Yu
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, 15289, PA, USA.,Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, 15260, PA, USA.,Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, 15289, PA, USA
| | - Matthew A Smith
- Department of Ophthalmology, University of Pittsburgh, Pittsburgh, 15213, PA, USA. .,Center for the Neural Basis of Cognition, Carnegie Mellon University and University of Pittsburgh, Pittsburgh, 15260, PA, USA. .,Department of Bioengineering, University of Pittsburgh, Pittsburgh, 15213, PA, USA.
| |
Collapse
|
23
|
Confirmation Bias through Selective Overweighting of Choice-Consistent Evidence. Curr Biol 2018; 28:3128-3135.e8. [PMID: 30220502 DOI: 10.1016/j.cub.2018.07.052] [Citation(s) in RCA: 61] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2018] [Revised: 06/06/2018] [Accepted: 07/19/2018] [Indexed: 02/08/2023]
Abstract
People's assessments of the state of the world often deviate systematically from the information available to them [1]. Such biases can originate from people's own decisions: committing to a categorical proposition, or a course of action, biases subsequent judgment and decision-making. This phenomenon, called confirmation bias [2], has been explained as suppression of post-decisional dissonance [3, 4]. Here, we provide insights into the underlying mechanism. It is commonly held that decisions result from the accumulation of samples of evidence informing about the state of the world [5-8]. We hypothesized that choices bias the accumulation process by selectively altering the weighting (gain) of subsequent evidence, akin to selective attention. We developed a novel psychophysical task to test this idea. Participants viewed two successive random dot motion stimuli and made two motion-direction judgments: a categorical discrimination after the first stimulus and a continuous estimation of the overall direction across both stimuli after the second stimulus. Participants' sensitivity for the second stimulus was selectively enhanced when that stimulus was consistent with the initial choice (compared to both, first stimuli and choice-inconsistent second stimuli). A model entailing choice-dependent selective gain modulation explained this effect better than several alternative mechanisms. Choice-dependent gain modulation was also established in another task entailing averaging of numerical values instead of motion directions. We conclude that intermittent choices direct selective attention during the evaluation of subsequent evidence, possibly due to decision-related feedback in the brain [9]. Our results point to a recurrent interplay between decision-making and selective attention.
Collapse
|
24
|
Having More Choices Changes How Human Observers Weight Stable Sensory Evidence. J Neurosci 2018; 38:8635-8649. [PMID: 30143576 DOI: 10.1523/jneurosci.0440-18.2018] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2018] [Revised: 08/07/2018] [Accepted: 08/14/2018] [Indexed: 02/04/2023] Open
Abstract
Decision-making becomes slower when more choices are available. Existing models attribute this slowing to poor sensory processing, to attenuated rates of sensory evidence accumulation, or to increases in the amount of evidence required before committing to a decision (a higher decision threshold). However, studies have not isolated the effects of having more choices on sensory and decision-related processes from changes in task difficulty and divided attention. Here, we controlled task difficulty while independently manipulating the distribution of attention and the number of choices available to male and female human observers. We used EEG to measure steady-state visually evoked potentials (SSVEPs) and a frontal late positive deflection (LPD), EEG markers of sensory and postsensory decision-related processes, respectively. We found that dividing attention decreased SSVEP and LPD amplitudes, consistent with dampened sensory responses and slower rates of evidence accumulation, respectively. In contrast, having more choices did not alter SSVEP amplitude and led to a larger LPD. These results suggest that having more options largely spares early sensory processing and slows down decision-making via a selective increase in decision thresholds.SIGNIFICANCE STATEMENT When more choices are available, decision-making becomes slower. We tested whether this phenomenon is due to poor sensory processing, to reduced rates of evidence accumulation, or to increases in the amount of evidence required before committing to a decision (a higher decision threshold). We measured choice modulations of sensory and decision-related neural responses using EEG. We also minimized potential confounds from changes in the distribution of attention and task difficulty, which often covary with having more choices. Dividing attention reduced the activity levels of both sensory and decision-related responses. However, having more choices did not change sensory processing and led to larger decision-related responses. These results suggest that having more choices spares sensory processing and selectively increases decision thresholds.
Collapse
|
25
|
Fazekas P, Overgaard M. Multiple Factors and Multiple Mechanisms Determine the Quality of Conscious Experiences: A Reply to Anzulewicz and Wierzchoń. Cogn Sci 2018; 42:2101-2103. [PMID: 30051506 DOI: 10.1111/cogs.12647] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2018] [Revised: 05/16/2018] [Accepted: 05/18/2018] [Indexed: 11/28/2022]
Abstract
In this Letter to the Editor, we seize the opportunity to respond to the recent comments by Anzulewicz and Wierzchoń, and further clarify and extend the scope of our original paper. We re-emphasize that conscious experiences come in degrees, and that there are several factors that determine this degree. Endorsing the suggestions of Anzulewicz and Wierzchoń, we discuss that besides low-level attentional mechanisms, high-level attentional and non-attentional mechanisms might also modulate the quality of conscious experiences.
Collapse
Affiliation(s)
- Peter Fazekas
- Centre for Philosophical Psychology, University of Antwerp
- Cognitive Neuroscience Research Unit, CFIN, Aarhus University
| | | |
Collapse
|
26
|
Cutrone EK, Heeger DJ, Carrasco M. On spatial attention and its field size on the repulsion effect. J Vis 2018; 18:8. [PMID: 30029219 PMCID: PMC6012187 DOI: 10.1167/18.6.8] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2017] [Accepted: 05/13/2018] [Indexed: 11/24/2022] Open
Abstract
We investigated the attentional repulsion effect-stimuli appear displaced further away from attended locations-in three experiments: one with exogenous (involuntary) attention, and two with endogenous (voluntary) attention with different attention-field sizes. It has been proposed that differences in attention-field size can account for qualitative differences in neural responses elicited by attended stimuli. We used psychophysical comparative judgments and manipulated either exogenous attention via peripheral cues or endogenous attention via central cues and a demanding rapid serial visual presentation task. We manipulated the attention field size of endogenous attention by presenting streams of letters at two specific locations or at two of many possible locations during each block. We found a robust attentional repulsion effect in all three experiments: with endogenous and exogenous attention and with both attention-field sizes. These findings advance our understanding of the influence of spatial attention on the perception of visual space and help relate this repulsion effect to possible neurophysiological correlates.
Collapse
Affiliation(s)
| | - David J Heeger
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
27
|
Rosli Y, Carle CF, Ho Y, James AC, Kolic M, Rohan EMF, Maddess T. Retinotopic effects of visual attention revealed by dichoptic multifocal pupillography. Sci Rep 2018; 8:2991. [PMID: 29445236 PMCID: PMC5813021 DOI: 10.1038/s41598-018-21196-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2017] [Accepted: 01/31/2018] [Indexed: 01/10/2023] Open
Abstract
Multifocal pupillographic objective perimetry (mfPOP) has recently been shown to be able to measure cortical function. Here we assessed 44 regions of the central 60 degrees of the visual fields of each eye concurrently in 7 minutes/test. We examined how foveally- and peripherally-directed attention changed response sensitivity and delay across the 44 visual field locations/eye. Four experiments were completed comparing white, yellow and blue stimulus arrays. Experiments 1 to 4 tested 16, 23, 9 and 6 subjects, 49/54 being unique. Experiment 1, Experiments 2 and 3, and Experiment 4 used three variants of the mfPOP method that provided increasingly improved signal quality. Experiments 1 to 3 examined centrally directed attention, and Experiment 4 compared effects of attention directed to different peripheral targets. Attention reduced the sensitivity of the peripheral locations in Experiment 1, but only for the white stimuli not yellow. Experiment 2 confirmed that result. Experiment 3 showed that blue stimuli behaved like white. Peripheral attention showed increased sensitivity around the attentional targets. The results are discussed in terms of the cortical inputs to the pupillary system. The results agree with those from multifocal and other fMRI and VEP studies. mfPOP may be a useful adjunct to those methods.
Collapse
Affiliation(s)
- Yanti Rosli
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
- Biomedical Science Program, Diagnostic & Applied Health Sciences, Faculty of Health Science, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, 50300, Kuala Lumpur, Malaysia
| | - Corinne Frances Carle
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Yiling Ho
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Andrew Charles James
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Maria Kolic
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
- Centre for Eye Research Australia, University of Melbourne, East Melbourne, Australia
| | - Emilie Marie Françoise Rohan
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia
| | - Ted Maddess
- Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University, Canberra, Australia.
| |
Collapse
|
28
|
Cavanaugh MR, Barbot A, Carrasco M, Huxlin KR. Feature-based attention potentiates recovery of fine direction discrimination in cortically blind patients. Neuropsychologia 2017; 128:315-324. [PMID: 29237554 DOI: 10.1016/j.neuropsychologia.2017.12.010] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2017] [Revised: 12/02/2017] [Accepted: 12/04/2017] [Indexed: 01/23/2023]
Abstract
Training chronic, cortically-blind (CB) patients on a coarse [left-right] direction discrimination and integration (CDDI) task recovers performance on this task at trained, blind field locations. However, fine direction difference (FDD) thresholds remain elevated at these locations, limiting the usefulness of recovered vision in daily life. Here, we asked if this FDD impairment can be overcome by training CB subjects with endogenous, feature-based attention (FBA) cues. Ten CB subjects were recruited and trained on CDDI and FDD with an FBA cue or FDD with a neutral cue. After completion of each training protocol, FDD thresholds were re-measured with both neutral and FBA cues at trained, blind-field locations and at corresponding, intact-field locations. In intact portions of the visual field, FDD thresholds were lower when tested with FBA than neutral cues. Training subjects in the blind field on the CDDI task improved FDD performance to the point that a threshold could be measured, but these locations remained impaired relative to the intact field. FDD training with neutral cues resulted in better blind field FDD thresholds than CDDI training, but thresholds remained impaired relative to intact field levels, regardless of testing cue condition. Importantly, training FDD in the blind field with FBA lowered FDD thresholds relative to CDDI training, and allowed the blind field to reach thresholds similar to the intact field, even when FBA trained subjects were tested with a neutral rather than FBA cue. Finally, FDD training appeared to also recover normal integration thresholds at trained, blind-field locations, providing an interesting double dissociation with respect to CDDI training. In summary, mechanisms governing FBA appear to function normally in both intact and impaired regions of the visual field following V1 damage. Our results mark the first time that FDD thresholds in CB fields have been seen to reach intact field levels of performance. Moreover, FBA can be leveraged during visual training to recover normal, fine direction discrimination and integration performance at trained, blind-field locations, potentiating visual recovery of more complex and precise aspects of motion perception in cortically-blinded fields.
Collapse
Affiliation(s)
- Matthew R Cavanaugh
- Flaum Eye Institute and Center for Visual Science, University of Rochester, Rochester, NY 14642, USA; Neuroscience Graduate Program, University of Rochester Medical Center, Rochester, NY 14642, USA
| | - Antoine Barbot
- Flaum Eye Institute and Center for Visual Science, University of Rochester, Rochester, NY 14642, USA
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, NY 10003, USA
| | - Krystel R Huxlin
- Flaum Eye Institute and Center for Visual Science, University of Rochester, Rochester, NY 14642, USA
| |
Collapse
|
29
|
Abstract
Attention to a feature enhances the sensory representation of that feature. Although much has been learned about the properties of attentional modulation when attending to a single feature, the effectiveness of attending to multiple features is not well understood. We investigated this question in a series of experiments using a color-detection task while varying the number of attended colors in a cueing paradigm. Observers were shown either a single cue, two cues, or no cue (baseline) before detecting a coherent color target. We measured detection threshold by varying the coherence level of the target. Compared to the baseline condition, we found consistent facilitation of detection performance in the one-cue and two-cue conditions, but performance in the two-cue condition was lower than that in the one-cue condition. In the final experiment, we presented a 50% valid cue to emulate the situation in which observers were only able to attend a single color in the two-cue condition, and found equivalent detection thresholds with the standard two-cue condition. These results indicate a limit in attending to two colors and further imply that observers could effectively attend a single color at a time. Such a limit is likely due to an inability to maintain multiple active attentional templates for colors.
Collapse
Affiliation(s)
- Taosheng Liu
- Department of Psychology, Michigan State University, 316 Physics Rd., East Lansing, MI, 48864, USA.
- Neuroscience Program, Michigan State University, East Lansing, MI, USA.
| | - Michael Jigo
- Department of Psychology, Michigan State University, 316 Physics Rd., East Lansing, MI, 48864, USA
| |
Collapse
|
30
|
Hadizadeh H. Energy-Efficient Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2017; 26:2882-2891. [PMID: 28391196 DOI: 10.1109/tip.2017.2690523] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In this paper, a novel method is presented for producing energy-efficient images, i.e., images that consume less electrical energy on energy-adaptive displays, yet have the same or very similar perceptual quality to their original images. The proposed method relies on the fact that the energy consumption of pixels in modern energy-adaptive displays like OLED displays is directly proportional to the luminance of the pixels. Hence, in this paper, to reduce the energy consumption of an image, while at the same time preserving its perceptual quality, it is proposed to reduce the luminance of the pixels in the image by one just-noticeable-difference (JND) threshold. To determine the JND thresholds, an adaptive saliency-modulated JND (SJND) model is developed. In the proposed model, the JND thresholds of each block in the given image are elevated by two non-linear saliency modulation functions using the visual saliency of the block. The parameters of the saliency modulation functions are estimated through an adaptive optimization framework, which utilizes a state-of-the-art saliency-based objective image quality assessment method. To evaluate the proposed methods, a set of subjective experiments were conducted, and the real energy consumption of the produced energy-efficient images were measured by an accurate power monitor equipment on an OLED display. The obtained experimental results demonstrated that, on average, the proposed method is able to reduce the energy consumption by about 14.1% while preserving the perceptual quality of the displayed images.
Collapse
|
31
|
Pratte MS, Tong F. Integrating Theoretical Models with Functional Neuroimaging. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2017; 76:80-93. [PMID: 28286346 PMCID: PMC5342841 DOI: 10.1016/j.jmp.2016.06.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The development of mathematical models to characterize perceptual and cognitive processes dates back almost to the inception of the field of psychology. Since the 1990s, human functional neuroimaging has provided for rapid empirical and theoretical advances across a variety of domains in cognitive neuroscience. In more recent work, formal modeling and neuroimaging approaches are being successfully combined, often producing models with a level of specificity and rigor that would not have been possible by studying behavior alone. In this review, we highlight examples of recent studies that utilize this combined approach to provide novel insights into the mechanisms underlying human cognition. The studies described here span domains of perception, attention, memory, categorization, and cognitive control, employing a variety of analytic and model-inspired approaches. Across these diverse studies, a common theme is that individually tailored, creative solutions are often needed to establish compelling links between multi-parameter models and complex sets of neural data. We conclude that future developments in model-based cognitive neuroscience will have great potential to advance our theoretical understanding and ability to model both low-level and high-level cognitive processes.
Collapse
Affiliation(s)
- Michael S. Pratte
- Department of Psychology, Mississippi State University
- Department of Psychology and the Vanderbilt Vision Research Center, Vanderbilt University
| | - Frank Tong
- Department of Psychology and the Vanderbilt Vision Research Center, Vanderbilt University
| |
Collapse
|
32
|
Schwedhelm P, Krishna BS, Treue S. An Extended Normalization Model of Attention Accounts for Feature-Based Attentional Enhancement of Both Response and Coherence Gain. PLoS Comput Biol 2016; 12:e1005225. [PMID: 27977679 PMCID: PMC5157945 DOI: 10.1371/journal.pcbi.1005225] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2016] [Accepted: 10/31/2016] [Indexed: 11/19/2022] Open
Abstract
Paying attention to a sensory feature improves its perception and impairs that of others. Recent work has shown that a Normalization Model of Attention (NMoA) can account for a wide range of physiological findings and the influence of different attentional manipulations on visual performance. A key prediction of the NMoA is that attention to a visual feature like an orientation or a motion direction will increase the response of neurons preferring the attended feature (response gain) rather than increase the sensory input strength of the attended stimulus (input gain). This effect of feature-based attention on neuronal responses should translate to similar patterns of improvement in behavioral performance, with psychometric functions showing response gain rather than input gain when attention is directed to the task-relevant feature. In contrast, we report here that when human subjects are cued to attend to one of two motion directions in a transparent motion display, attentional effects manifest as a combination of input and response gain. Further, the impact on input gain is greater when attention is directed towards a narrow range of motion directions than when it is directed towards a broad range. These results are captured by an extended NMoA, which either includes a stimulus-independent attentional contribution to normalization or utilizes direction-tuned normalization. The proposed extensions are consistent with the feature-similarity gain model of attention and the attentional modulation in extrastriate area MT, where neuronal responses are enhanced and suppressed by attention to preferred and non-preferred motion directions respectively. We report a pattern of feature-based attentional effects on human psychophysical performance, which cannot be accounted for by the Normalization Model of Attention using biologically plausible parameters. Specifically, this prominent model of attentional modulation predicts that attention to a visual feature like a specific motion direction will lead to a response gain in the input-response function, rather than the input gain that we actually observe. In our data, the input gain is greater when attention is directed towards a narrow range of motion directions, again contrary to the model’s prediction. We therefore propose two physiologically testable extensions of the model that include direction-tuned normalization mechanisms of attention. Both extensions account for our data without affecting the previously demonstrated successful performance of the NMoA.
Collapse
Affiliation(s)
- Philipp Schwedhelm
- Cognitive Neuroscience Laboratory, German Primate Center - Leibniz Institute for Primate Research, Goettingen, Germany
- Bernstein Center for Computational Neuroscience, Goettingen, Germany
- * E-mail: (PS); (ST)
| | - B. Suresh Krishna
- Cognitive Neuroscience Laboratory, German Primate Center - Leibniz Institute for Primate Research, Goettingen, Germany
| | - Stefan Treue
- Cognitive Neuroscience Laboratory, German Primate Center - Leibniz Institute for Primate Research, Goettingen, Germany
- Bernstein Center for Computational Neuroscience, Goettingen, Germany
- Faculty of Biology and Psychology, Goettingen University, Goettingen, Germany
- Leibniz-ScienceCampus Primate Cognition, Goettingen, Germany
- * E-mail: (PS); (ST)
| |
Collapse
|
33
|
Hadizadeh H. A saliency-modulated just-noticeable-distortion model with non-linear saliency modulation functions. Pattern Recognit Lett 2016. [DOI: 10.1016/j.patrec.2016.08.011] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
34
|
|
35
|
Romeo A, Supèr H. Feature-Based Attention by Lateral Spike Synchronization. Neural Comput 2016; 28:629-51. [PMID: 26890346 DOI: 10.1162/neco_a_00822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
We introduce a neural model capable of feature selectiveness by spike-mediated synchronization through lateral synaptic couplings. For a stimulus containing two features, the attended one elicits a higher response. In the case of sequential single-feature stimuli, repetition of the attended feature also results in an enhanced response, exhibited by greater synchrony and higher spiking rates.
Collapse
Affiliation(s)
- August Romeo
- Department of Basic Psychology, Faculty of Psychology, University of Barcelona, Barcelona 08035, Spain
| | - Hans Supèr
- Department of Basic Psychology, Faculty of Psychology, University of Barcelona, Barcelona 08035, Spain; Institute for Brain, Cognition, and Behavior, Barcelona 08035, Spain; and Catalan Institution for Research and Advanced Studies, Barcelona 08010, Spain
| |
Collapse
|
36
|
White AL, Rolfs M, Carrasco M. Stimulus competition mediates the joint effects of spatial and feature-based attention. J Vis 2016; 15:7. [PMID: 26473316 DOI: 10.1167/15.14.7] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Distinct attentional mechanisms enhance the sensory processing of visual stimuli that appear at task-relevant locations and have task-relevant features. We used a combination of psychophysics and computational modeling to investigate how these two types of attention--spatial and feature based--interact to modulate sensitivity when combined in one task. Observers monitored overlapping groups of dots for a target change in color saturation, which they had to localize as being in the upper or lower visual hemifield. Pre-cues indicated the target's most likely location (left/right), color (red/green), or both location and color. We measured sensitivity (d') for every combination of the location cue and the color cue, each of which could be valid, neutral, or invalid. When three competing saturation changes occurred simultaneously with the target change, there was a clear interaction: The spatial cueing effect was strongest for the cued color, and the color cueing effect was strongest at the cued location. In a second experiment, only the target dot group changed saturation, such that stimulus competition was low. The resulting cueing effects were statistically independent and additive: The color cueing effect was equally strong at attended and unattended locations. We account for these data with a computational model in which spatial and feature-based attention independently modulate the gain of sensory responses, consistent with measurements of cortical activity. Multiple responses then compete via divisive normalization. Sufficient competition creates interactions between the two cueing effects, although the attentional systems are themselves independent. This model helps reconcile seemingly disparate behavioral and physiological findings.
Collapse
|
37
|
Attention Determines Contextual Enhancement versus Suppression in Human Primary Visual Cortex. J Neurosci 2015; 35:12273-80. [PMID: 26338337 DOI: 10.1523/jneurosci.1409-15.2015] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Abstract
UNLABELLED Neural responses in primary visual cortex (V1) depend on stimulus context in seemingly complex ways. For example, responses to an oriented stimulus can be suppressed when it is flanked by iso-oriented versus orthogonally oriented stimuli but can also be enhanced when attention is directed to iso-oriented versus orthogonal flanking stimuli. Thus the exact same contextual stimulus arrangement can have completely opposite effects on neural responses-in some cases leading to orientation-tuned suppression and in other cases leading to orientation-tuned enhancement. Here we show that stimulus-based suppression and enhancement of fMRI responses in humans depends on small changes in the focus of attention and can be explained by a model that combines feature-based attention with response normalization. SIGNIFICANCE STATEMENT Neurons in the primary visual cortex (V1) respond to stimuli within a restricted portion of the visual field, termed their "receptive field." However, neuronal responses can also be influenced by stimuli that surround a receptive field, although the nature of these contextual interactions and underlying neural mechanisms are debated. Here we show that the response in V1 to a stimulus in the same context can either be suppressed or enhanced depending on the focus of attention. We are able to explain the results using a simple computational model that combines two well established properties of visual cortical responses: response normalization and feature-based enhancement.
Collapse
|
38
|
From shunting inhibition to dynamic normalization: Attentional selection and decision-making in brief visual displays. Vision Res 2015; 116:219-40. [DOI: 10.1016/j.visres.2014.11.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2014] [Revised: 10/25/2014] [Accepted: 11/01/2014] [Indexed: 11/22/2022]
|
39
|
Li HH, Carrasco M, Heeger DJ. Deconstructing Interocular Suppression: Attention and Divisive Normalization. PLoS Comput Biol 2015; 11:e1004510. [PMID: 26517321 PMCID: PMC4627721 DOI: 10.1371/journal.pcbi.1004510] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2015] [Accepted: 08/20/2015] [Indexed: 11/18/2022] Open
Abstract
In interocular suppression, a suprathreshold monocular target can be rendered invisible by a salient competitor stimulus presented in the other eye. Despite decades of research on interocular suppression and related phenomena (e.g., binocular rivalry, flash suppression, continuous flash suppression), the neural processing underlying interocular suppression is still unknown. We developed and tested a computational model of interocular suppression. The model included two processes that contributed to the strength of interocular suppression: divisive normalization and attentional modulation. According to the model, the salient competitor induced a stimulus-driven attentional modulation selective for the location and orientation of the competitor, thereby increasing the gain of neural responses to the competitor and reducing the gain of neural responses to the target. Additional suppression was induced by divisive normalization in the model, similar to other forms of visual masking. To test the model, we conducted psychophysics experiments in which both the size and the eye-of-origin of the competitor were manipulated. For small and medium competitors, behavioral performance was consonant with a change in the response gain of neurons that responded to the target. But large competitors induced a contrast-gain change, even when the competitor was split between the two eyes. The model correctly predicted these results and outperformed an alternative model in which the attentional modulation was eye specific. We conclude that both stimulus-driven attention (selective for location and feature) and divisive normalization contribute to interocular suppression. In interocular suppression, a visible target presented in one eye can be rendered invisible by a competing image (the competitor) presented in the other eye. This phenomenon is a striking demonstration of the discrepancy between physical inputs to the visual system and perception, and it also allows neuroscientists to study how perceptual systems regulate competing information. Interocular suppression has been explained by mutually suppressive interactions (modeled by divisive normalization) between neurons that respond differentially to the two eyes. Attention, which selects relevant information in natural viewing condition, has also been found to play a role in interocular suppression. But the specific role of attentional modulation is still an open question. In this study, we proposed a computational model of interocular suppression integrating both attentional modulation and divisive normalization. By modeling the hypothetical neural responses and fitting the model to psychophysical data, we showed that interocular suppression involves an attentional modulation selective for the orientation of the competitor, and covering the spatial extent of the competitor. We conclude that both attention and divisive normalization contribute to interocular suppression, and that their impacts are distinguishable.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, New York, United States of America
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, New York, United States of America
- Center for Neural Science, New York University, New York, New York, United States of America
| | - David J. Heeger
- Department of Psychology, New York University, New York, New York, United States of America
- Center for Neural Science, New York University, New York, New York, United States of America
- * E-mail:
| |
Collapse
|
40
|
Abstract
Stimuli appearing in the surround of the classical receptive field (CRF) can reduce neuronal firing and perceived contrast of a preferred stimulus in the CRF, a phenomenon referred to as surround suppression. Suppression is greatest when the surrounding stimulus has the same orientation and spatial frequency (SF) as the central target. Although spatial attention has been shown to influence surround suppression, the effects of feature-based attention have yet to be characterized. Using behavioral contrast adaptation in humans, we examined center-surround interactions between SF and orientation, and asked whether attending to one feature dimension versus the other influenced suppression. A center-surround triplet comprised of a central target Gabor and two flanking Gabors were used for adaptation. The flankers could have the same SF and orientation as the target, or differ in one or both of the feature dimensions. Contrast thresholds were measured for the target before and after adapting to center-surround triplets, and postadaptation thresholds were taken as an indirect measure of surround suppression. Both feature dimensions contributed to surround suppression and did not summate. Moreover, when center and surround had the same feature value in one dimension (e.g., same orientation) but had different values in the other dimension (e.g., different SF), there was more suppression when attention was directed to the feature dimension that matched between center and surround than when attention was directed to the feature dimension that differed. These results demonstrate that feature-based attention can influence center-surround interactions by enhancing the effects of the attended dimension.
Collapse
Affiliation(s)
| | - Scott O Murray
- Department of Psychology, University of Washington, Seattle, WA, USA
| |
Collapse
|
41
|
Cutrone EK, Heeger DJ, Carrasco M. Attention enhances contrast appearance via increased input baseline of neural responses. J Vis 2014; 14:16. [PMID: 25549920 DOI: 10.1167/14.14.16] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023] Open
Abstract
Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, using a two-alternative, forced-choice comparison task to probe the effect of attention on appearance across the contrast range. We modeled performance in the task as a function of underlying neural contrast-response functions. Fitting this model to the observed data revealed that an increased input baseline in the neural responses accounted for the enhancement of apparent contrast with spatial attention.
Collapse
Affiliation(s)
| | - David J Heeger
- Department of Psychology, New York University, New York, NY, USA Center for Neural Science, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
42
|
Pack W, Klein SA, Carney T. Bias corrected double judgment accuracy during spatial attention cueing: Unmasked stimuli with non-predictive and semi-predictive cues. Vision Res 2014; 105:213-25. [DOI: 10.1016/j.visres.2014.07.017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2013] [Revised: 07/27/2014] [Accepted: 07/29/2014] [Indexed: 01/01/2023]
|
43
|
Bobier B, Stewart TC, Eliasmith C. A unifying mechanistic model of selective attention in spiking neurons. PLoS Comput Biol 2014; 10:e1003577. [PMID: 24921249 PMCID: PMC4055282 DOI: 10.1371/journal.pcbi.1003577] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2013] [Accepted: 03/04/2014] [Indexed: 11/30/2022] Open
Abstract
Visuospatial attention produces myriad effects on the activity and selectivity of cortical neurons. Spiking neuron models capable of reproducing a wide variety of these effects remain elusive. We present a model called the Attentional Routing Circuit (ARC) that provides a mechanistic description of selective attentional processing in cortex. The model is described mathematically and implemented at the level of individual spiking neurons, with the computations for performing selective attentional processing being mapped to specific neuron types and laminar circuitry. The model is used to simulate three studies of attention in macaque, and is shown to quantitatively match several observed forms of attentional modulation. Specifically, ARC demonstrates that with shifts of spatial attention, neurons may exhibit shifting and shrinking of receptive fields; increases in responses without changes in selectivity for non-spatial features (i.e. response gain), and; that the effect on contrast-response functions is better explained as a response-gain effect than as contrast-gain. Unlike past models, ARC embodies a single mechanism that unifies the above forms of attentional modulation, is consistent with a wide array of available data, and makes several specific and quantifiable predictions. At a given moment, a tremendous amount of visual information falls on the retinae, far more than the brain is capable of processing. By directing attention to a spatial location, stimuli at that position can be selectively processed, while irrelevant information from non-attended locations can be largely ignored. We present a detailed model that describes the mechanisms by which visual spatial attention may be implemented in the brain. Using this model, we simulated three previous studies of spatial attention in primates, and analysed the simulation data using the same methods as in the original experiments. Across these simulations, and without altering model parameters, our model produces results that are statistically indistinguishable from those recorded in primates. Unlike previous work, our model provides greater biological detail of how the brain performs selective visual processing, while also accurately demonstrating numerous forms of selective attention. Our results suggest that these seemingly different forms of attentional effects may result from a single mechanism for selectively processing attended stimuli.
Collapse
Affiliation(s)
- Bruce Bobier
- Centre for Theoretical Neuroscience, University of Waterloo, Waterloo, Ontario, Canada
- * E-mail:
| | - Terrence C. Stewart
- Centre for Theoretical Neuroscience, University of Waterloo, Waterloo, Ontario, Canada
| | - Chris Eliasmith
- Centre for Theoretical Neuroscience, University of Waterloo, Waterloo, Ontario, Canada
| |
Collapse
|
44
|
Chaumon M, Busch NA. Prestimulus neural oscillations inhibit visual perception via modulation of response gain. J Cogn Neurosci 2014; 26:2514-29. [PMID: 24742156 DOI: 10.1162/jocn_a_00653] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The ongoing state of the brain radically affects how it processes sensory information. How does this ongoing brain activity interact with the processing of external stimuli? Spontaneous oscillations in the alpha range are thought to inhibit sensory processing, but little is known about the psychophysical mechanisms of this inhibition. We recorded ongoing brain activity with EEG while human observers performed a visual detection task with stimuli of different contrast intensities. To move beyond qualitative description, we formally compared psychometric functions obtained under different levels of ongoing alpha power and evaluated the inhibitory effect of ongoing alpha oscillations in terms of contrast or response gain models. This procedure opens the way to understanding the actual functional mechanisms by which ongoing brain activity affects visual performance. We found that strong prestimulus occipital alpha oscillations-but not more anterior mu oscillations-reduce performance most strongly for stimuli of the highest intensities tested. This inhibitory effect is best explained by a divisive reduction of response gain. Ongoing occipital alpha oscillations thus reflect changes in the visual system's input/output transformation that are independent of the sensory input to the system. They selectively scale the system's response, rather than change its sensitivity to sensory information.
Collapse
|
45
|
Cortical neural populations can guide behavior by integrating inputs linearly, independent of synchrony. Proc Natl Acad Sci U S A 2013; 111:E178-87. [PMID: 24367105 DOI: 10.1073/pnas.1318750111] [Citation(s) in RCA: 67] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Neurons are sensitive to the relative timing of inputs, both because several inputs must coincide to reach spike threshold and because active dendritic mechanisms can amplify synchronous inputs. To determine if input synchrony can influence behavior, we trained mice to report activation of excitatory neurons in visual cortex using channelrhodopsin-2. We used light pulses that varied in duration from a few milliseconds to 100 ms and measured neuronal responses and animals' detection ability. We found detection performance was well predicted by the total amount of light delivered. Short pulses provided no behavioral advantage, even when they concentrated evoked spikes into an interval a few milliseconds long. Arranging pulses into trains of varying frequency from beta to gamma also produced no behavioral advantage. Light intensities required to drive behavior were low (at low intensities, channelrhodopsin-2 conductance varies linearly with intensity), and the accompanying changes in firing rate were small (over 100 ms, average change: 1.1 spikes per s). Firing rate changes varied linearly with pulse intensity and duration, and behavior was predicted by total spike count independent of temporal arrangement. Thus, animals' detection performance reflected the linear integration of total input over 100 ms. This behavioral linearity despite neurons' nonlinearities can be explained by a population code using noisy neurons. Ongoing background activity creates probabilistic spiking, allowing weak inputs to change spike probability linearly, with little amplification of coincident input. Summing across a population then yields a total spike count that weights inputs equally, regardless of their arrival time.
Collapse
|
46
|
Chen Y, Li H, Jin Z, Shou T, Yu H. Feedback of the amygdala globally modulates visual response of primary visual cortex in the cat. Neuroimage 2013; 84:775-85. [PMID: 24045078 DOI: 10.1016/j.neuroimage.2013.09.010] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2013] [Revised: 09/04/2013] [Accepted: 09/05/2013] [Indexed: 01/28/2023] Open
Abstract
The amygdala is an important center for emotional behavior, and it influences other cortical regions. Long feedback projections from the amygdala to the primary visual cortex were recently reported in the cat and monkey, two animal models for vision research. However, the detailed functional roles of these extensive projections still remain largely unknown. In this study, intrinsic signal optical imaging was used to investigate the visually driven responses of the primary visual cortex of cats as focal drugs were injected into the basal nucleus of the amygdala. Both the visually evoked global signals and differential signals in the functional maps of the primary visual cortex were enhanced or reduced by glutamate-induced activation or GABA-induced deactivation of neurons in the amygdala, respectively. This modulation was found to be non-selective, consistent with the gain control mechanism-both the preferred orientation and its mapped orientation tuning width remained unchanged. The single unit recordings showed similar results supporting the above observations. These results suggest that the distal feedback signals of the amygdala enhance the primary sensory information processing in a non-selective, gain-control fashion. This provides direct neurophysiological evidence and insight for previous studies on emotional-cue related psychological studies.
Collapse
Affiliation(s)
- Yuanxin Chen
- Vision Research Laboratory, Center for Brain Science Research and School of Life Sciences, Fudan University, 220 Handan Road, Shanghai 200433, China
| | | | | | | | | |
Collapse
|
47
|
Carrasco M, Eckstein M, Krauzlis R, Verghese P. Attentional modulation: target selection, active search and cognitive processing. Vision Res 2013; 85:1-4. [PMID: 23747085 DOI: 10.1016/j.visres.2013.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
48
|
Grubb MA, Behrmann M, Egan R, Minshew NJ, Carrasco M, Heeger DJ. Endogenous spatial attention: evidence for intact functioning in adults with autism. Autism Res 2013; 6:108-18. [PMID: 23427075 DOI: 10.1002/aur.1269] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2012] [Accepted: 12/05/2012] [Indexed: 01/08/2023]
Abstract
Rapid manipulation of the attention field (i.e. the location and spread of visual spatial attention) is a critical aspect of human cognition, and previous research on spatial attention in individuals with autism spectrum disorders (ASD) has produced inconsistent results. In a series of three psychophysical experiments, we evaluated claims in the literature that individuals with ASD exhibit a deficit in voluntarily controlling the deployment and size of the spatial attention field. We measured the spatial distribution of performance accuracies and reaction times to quantify the sizes and locations of the attention field, with and without spatial uncertainty (i.e. the lack of predictability concerning the spatial position of the upcoming stimulus). We found that high-functioning adults with autism exhibited slower reaction times overall with spatial uncertainty, but the effects of attention on performance accuracies and reaction times were indistinguishable between individuals with autism and typically developing individuals in all three experiments. These results provide evidence of intact endogenous spatial attention function in high-functioning adults with ASD, suggesting that atypical endogenous attention cannot be a latent characteristic of autism in general.
Collapse
Affiliation(s)
- Michael A Grubb
- Department of Psychology, New York University, New York, New York, USA
| | | | | | | | | | | |
Collapse
|
49
|
Liu T, Becker MW, Jigo M. Limited featured-based attention to multiple features. Vision Res 2012; 85:36-44. [PMID: 22983060 DOI: 10.1016/j.visres.2012.09.001] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2012] [Revised: 08/22/2012] [Accepted: 09/03/2012] [Indexed: 11/25/2022]
Abstract
Attending to a feature (e.g., color or motion direction) can enhance the early visual processing of that feature. However, it is not known whether one can simultaneously enhance multiple features. We examined people's ability to attend to multiple features in a feature cueing paradigm. Each trial contained two intervals consisting of a random dot motion stimulus. One interval (noise) had 0% coherence (no net motion), while the other interval (signal) moved in a particular direction with varying levels of coherence. Participants reported which interval contained the signal in one of three cueing conditions. In the one-cue condition, a line segment preceded the stimuli indicating the direction of the signal with 100% validity. In the two-cue condition, two lines preceded the stimuli, indicating the signal would move in one of the two cued directions. In the no-cue condition, no line segment appeared before the dot stimuli. In several experiments, we consistently observed a lower detection threshold in the one-cue condition than the no-cue condition, showing that participants can enhance processing of a single feature. However, detection threshold was consistently higher for the two-cue than one-cue condition, indicating that participants could not simultaneously enhance two motion directions as effectively as one direction. This finding revealed a severe capacity limit in our ability to enhance early visual processing for multiple features.
Collapse
Affiliation(s)
- Taosheng Liu
- Department of Psychology, Michigan State University, East Lansing, MI 48824, USA.
| | | | | |
Collapse
|
50
|
Ho TC, Brown S, Abuyo NA, Ku EHJ, Serences JT. Perceptual consequences of feature-based attentional enhancement and suppression. J Vis 2012; 12:15. [PMID: 22923726 PMCID: PMC4503215 DOI: 10.1167/12.8.15] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2012] [Accepted: 07/06/2012] [Indexed: 11/24/2022] Open
Abstract
Feature-based attention has been shown to enhance the responses of neurons tuned to an attended feature while simultaneously suppressing responses of neurons tuned to unattended features. However, the influence of these suppressive neuronal-level modulations on perception is not well understood. Here, we investigated the perceptual consequences of feature-based attention by having subjects judge which of four random dot patterns (RDPs) contained a motion signal (Experiment 1) or which of four RDPs contained the most salient nonrandom motion signal (Experiment 2). Subjects viewed pre-cues which validly, invalidly, or neutrally cued the direction of the target RDP. Behavioral data were fit using the linear ballistic accumulator (LBA) model; the model design that best described the data revealed that the rate of sensory evidence accumulation (drift rate) was highest on valid trials and systematically decreased until the cued direction and the target direction were orthogonal. These results demonstrate behavioral correlates of both feature-based attentional enhancement and suppression.
Collapse
Affiliation(s)
- Tiffany C. Ho
- Department of Psychology, University of California, San Diego, USA
| | - Scott Brown
- School of Psychology, University of Newcastle, NSW, Australia
| | - Newton A. Abuyo
- Department of Psychology, University of California, San Diego, USA
| | - Eun-Hae J. Ku
- Department of Psychology, University of California, San Diego, USA
| | - John T. Serences
- Department of Psychology, University of California, San Diego, USA Neuroscience Graduate Program, University of California, San Diego, USA
| |
Collapse
|