1
|
Shipp S. Computational components of visual predictive coding circuitry. Front Neural Circuits 2024; 17:1254009. [PMID: 38259953 PMCID: PMC10800426 DOI: 10.3389/fncir.2023.1254009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 12/13/2023] [Indexed: 01/24/2024] Open
Abstract
If a full visual percept can be said to be a 'hypothesis', so too can a neural 'prediction' - although the latter addresses one particular component of image content (such as 3-dimensional organisation, the interplay between lighting and surface colour, the future trajectory of moving objects, and so on). And, because processing is hierarchical, predictions generated at one level are conveyed in a backward direction to a lower level, seeking to predict, in fact, the neural activity at that prior stage of processing, and learning from errors signalled in the opposite direction. This is the essence of 'predictive coding', at once an algorithm for information processing and a theoretical basis for the nature of operations performed by the cerebral cortex. Neural models for the implementation of predictive coding invoke specific functional classes of neuron for generating, transmitting and receiving predictions, and for producing reciprocal error signals. Also a third general class, 'precision' neurons, tasked with regulating the magnitude of error signals contingent upon the confidence placed upon the prediction, i.e., the reliability and behavioural utility of the sensory data that it predicts. So, what is the ultimate source of a 'prediction'? The answer is multifactorial: knowledge of the current environmental context and the immediate past, allied to memory and lifetime experience of the way of the world, doubtless fine-tuned by evolutionary history too. There are, in consequence, numerous potential avenues for experimenters seeking to manipulate subjects' expectation, and examine the neural signals elicited by surprising, and less surprising visual stimuli. This review focuses upon the predictive physiology of mouse and monkey visual cortex, summarising and commenting on evidence to date, and placing it in the context of the broader field. It is concluded that predictive coding has a firm grounding in basic neuroscience and that, unsurprisingly, there remains much to learn.
Collapse
Affiliation(s)
- Stewart Shipp
- Institute of Ophthalmology, University College London, London, United Kingdom
| |
Collapse
|
2
|
Gu Y, Chen ZS, Wang C, Song XM, Lu S, Cai YC. Spatial suppression of chromatic motion. Vision Res 2021; 188:227-233. [PMID: 34385078 DOI: 10.1016/j.visres.2021.07.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 07/03/2021] [Accepted: 07/20/2021] [Indexed: 10/20/2022]
Abstract
Center-surround antagonism, as a ubiquitous feature in visual processing, usually leads to inferior perception for a large stimulus compared to a small one. For example, it is more difficult to judge the motion direction of a large high-contrast pattern than that of a small one. However, this spatial suppression in the motion dimension was only reported for luminance motion, and was not found for chromatic motion. Given that center-surround suppression only occurs for strong visual inputs, we hypothesized that previous failure in finding spatial suppression of chromatic motion might be due to weak chromatic motion being induced with stimuli of limited parameters. In this study, we used phase-shift discrimination and motion-direction discrimination tasks to measure motion spatial suppression induced by stimuli of two spatial frequencies (0.5 and 2 cpd) and two contrasts (low and high). We found that spatial suppression of the chromatic motion was stably observed for stimuli of high spatial frequency (2 cpd) and high contrast and spatial summation occurred for stimuli of low spatial frequency (0.5 cpd). Intriguingly, there was no correlations between the motion spatial suppressions of luminance motion and chromatic motion, implying that the two types of spatial suppression are not originated from the same neural processing. Our findings indicate that spatial suppression also exists for chromatic motion, and the mechanisms underlying the spatial suppression of chromatic motion is different from that of luminance motion.
Collapse
Affiliation(s)
- Ye Gu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang 310028, China
| | - Zhang-Shan Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang 310028, China
| | - Ci Wang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang 310028, China
| | - Xue-Mei Song
- Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Shena Lu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang 310028, China.
| | - Yong-Chun Cai
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang 310028, China.
| |
Collapse
|
3
|
Luo J, Chen Z, Lu Y, Spillmann L, Andolina IM, Wang W. The Serpentine Illusion: A Visual Motion Illusion Induced by Phase-Shifted Line Gratings. Front Neurosci 2020; 14:612153. [PMID: 33424543 PMCID: PMC7793819 DOI: 10.3389/fnins.2020.612153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 11/13/2020] [Indexed: 11/16/2022] Open
Abstract
In a pattern of horizontal lines containing ± 45° zigzagging phase-shifted strips, vivid illusory motion is perceived when the pattern is translated up or down at a moderate speed. Two forms of illusory motion are seen: [i] a motion "racing" along the diagonal interface between the strips and [ii] lateral (sideways) motion of the strip sections. We found the relative salience of these two illusory motions to be strongly influenced by the vertical spacing and length of the line gratings, and the period length of the zigzag strips. Both illusory motions are abolished when the abutting strips are interleaved, separated by a gap or when a real line is superimposed at the interface. Illusory motion is also severely weakened when equiluminant colored grating lines are used. Illusory motion perception is fully restored at < 20% luminance contrast. Using adaptation, we find that line-ends alone are insufficient for illusory motion perception, and that both physical carrier motion and line orientation are required. We finally test a classical spatiotemporal energy model of V1 cells that exhibit direction tuning changes that are consistent with the direction of illusory motion. Taking this data together, we constructed a new visual illusion and surmise its origin to interactions of spatial and temporal energy of the lines and line-ends preferentially driving the magnocellular pathway.
Collapse
Affiliation(s)
- Junxiang Luo
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, China
| | - Zheyuan Chen
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, China
| | - Yiliang Lu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, China
| | - Lothar Spillmann
- Department of Neurology, University of Freiburg, Freiburg im Breisgau, Germany
| | - Ian Max Andolina
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, China
| | - Wei Wang
- Institute of Neuroscience, State Key Laboratory of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
4
|
Alterations of resting-state functional network centrality in patients with asthma: evidence from a voxel-wise degree centrality analysis. Neuroreport 2019; 29:1151-1156. [PMID: 29975256 DOI: 10.1097/wnr.0000000000001087] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Several previous studies have reported that asthma patients have abnormal brain activities, whereas alterations in the resting-state network still remain unknown. The aim of this study was to investigate the changes in functional network centrality in asthma patients using voxel-wise degree centrality (DC) method. Asthma patients and healthy controls (HCs) were matched closely in age, sex, and education of participants. The DC method was used to evaluate the functional network centrality. The receiver operating characteristic curve was used to distinguish the asthma group from the HCs group. The Pearson correlation coefficient was used to explore the relationship between the observed mean values of DC in different brain areas and the behavioral performance. Compared with HCs, DC values were significantly decreased in the right middle temporal gyrus and the right putamen of asthma patients. In contrast, in asthma patients, DC values were markedly increased in the right posterior lobe of the cerebellum, right inferior temporal gyrus, left superior frontal gyrus, left postcentral gyrus and inferior parietal lobule, left middle frontal gyrus, and left postcentral gyrus. However, there was no relationship between the observed mean DC values in different brain areas and the behavioral performance. The results showed that the DC values were altered in various brain regions of asthma patients, which were related to default mode network, the cortex-basal ganglia network, the frontoparietal network, and the sensorimotor network, leading to some useful information for clinical studies in asthma patients.
Collapse
|
5
|
Parto Dezfouli M, Khamechian MB, Treue S, Esghaei M, Daliri MR. Neural Activity Predicts Reaction in Primates Long Before a Behavioral Response. Front Behav Neurosci 2018; 12:207. [PMID: 30271333 PMCID: PMC6146178 DOI: 10.3389/fnbeh.2018.00207] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2018] [Accepted: 08/20/2018] [Indexed: 01/27/2023] Open
Abstract
How neural activity is linked to behavior is a critical question in neural engineering and cognitive neurosciences. It is crucial to predict behavior as early as possible, to plan a machine response in real-time brain computer interactions. However, previous studies have studied the neural readout of behavior only within a short time before the action is performed. This leaves unclear, if the neural activity long before a decision could predict the upcoming behavior. By recording extracellular neural activities from the visual cortex of behaving rhesus monkeys, we show that: (1) both, local field potentials (LFPs) and the rate of neural spikes long before (>2 s) a monkey responds to a change, foretell its behavioral performance in a spatially selective manner; (2) LFPs, the more accessible component of extracellular activity, are a stronger predictor of behavior; and (3) LFP amplitude is positively correlated while spiking activity is negatively correlated with behavioral reaction time (RT). These results suggest that field potentials could be used to predict behavior way before it is performed, an observation that could potentially be useful for brain computer interface applications, and that they contribute to the sensory neural circuit’s speed in information processing.
Collapse
Affiliation(s)
- Mohsen Parto Dezfouli
- Neuroscience and Neuroengineering Research Laboratory, Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran
| | - Mohammad Bagher Khamechian
- Neuroscience and Neuroengineering Research Laboratory, Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran
| | - Stefan Treue
- Cognitive Neuroscience Laboratory, German Primate Center-Leibniz Institute for Primate Research, Goettingen, Germany.,Faculty of Biology and Psychology, University of Goettingen, Goettingen, Germany.,Bernstein Center for Computational Neuroscience, Goettingen, Germany.,Leibniz-Science Campus Primate Cognition, Goettingen, Germany
| | - Moein Esghaei
- Neuroscience and Neuroengineering Research Laboratory, Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran.,Cognitive Neuroscience Laboratory, German Primate Center-Leibniz Institute for Primate Research, Goettingen, Germany.,Cognitive Neurobiology Laboratory, School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, Iran
| | - Mohammad Reza Daliri
- Neuroscience and Neuroengineering Research Laboratory, Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran.,Cognitive Neurobiology Laboratory, School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, Iran
| |
Collapse
|
6
|
Dürsteler MR. A common framework for the analysis of complex motion? Standstill and capture illusions. Front Hum Neurosci 2015; 8:999. [PMID: 25566023 PMCID: PMC4270218 DOI: 10.3389/fnhum.2014.00999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2014] [Accepted: 11/24/2014] [Indexed: 12/04/2022] Open
Abstract
A series of illusions was created by presenting stimuli, which consisted of two overlapping surfaces each defined by textures of independent visual features (i.e., modulation of luminance, color, depth, etc.). When presented concurrently with a stationary 2-D luminance texture, observers often fail to perceive the motion of an overlapping stereoscopically defined depth-texture. This illusory motion standstill arises due to a failure to represent two independent surfaces (one for luminance and one for depth textures) and motion transparency (the ability to perceive motion of both surfaces simultaneously). Instead the stimulus is represented as a single non-transparent surface taking on the stationary nature of the luminance-defined texture. By contrast, if it is the 2D-luminance defined texture that is in motion, observers often perceive the stationary depth texture as also moving. In this latter case, the failure to represent the motion transparency of the two textures gives rise to illusionary motion capture. Our past work demonstrated that the illusions of motion standstill and motion capture can occur for depth-textures that are rotating, or expanding / contracting, or else spiraling. Here I extend these findings to include stereo-shearing. More importantly, it is the motion (or lack thereof) of the luminance texture that determines how the motion of the depth will be perceived. This observation is strongly in favor of a single pathway for complex motion that operates on luminance-defines texture motion signals only. In addition, these complex motion illusions arise with chromatically-defined textures with smooth transitions between their colors. This suggests that in respect to color motion perception the complex motions' pathway is only able to accurately process signals from isoluminant colored textures with sharp transitions between colors, and/or moving at high speeds, which is conceivable if it relies on inputs from a hypothetical dual opponent color pathway.
Collapse
Affiliation(s)
- Max R Dürsteler
- Vestibulo-Oculomotor Lab., Department of Neurology, University Hospital Zürich Zürich, Switzerland
| |
Collapse
|
7
|
Abstract
Explanations for color phenomena are often sought in the retina, lateral geniculate nucleus, and V1, yet it is becoming increasingly clear that a complete account will take us further along the visual-processing pathway. Working out which areas are involved is not trivial. Responses to S-cone activation are often assumed to indicate that an area or neuron is involved in color perception. However, work tracing S-cone signals into extrastriate cortex has challenged this assumption: S-cone responses have been found in brain regions, such as the middle temporal (MT) motion area, not thought to play a major role in color perception. Here, we review the processing of S-cone signals across cortex and present original data on S-cone responses measured with fMRI in alert macaque, focusing on one area in which S-cone signals seem likely to contribute to color (V4/posterior inferior temporal cortex) and on one area in which S signals are unlikely to play a role in color (MT). We advance a hypothesis that the S-cone signals in color-computing areas are required to achieve a balanced neural representation of perceptual color space, whereas those in noncolor-areas provide a cue to illumination (not luminance) and confer sensitivity to the chromatic contrast generated by natural daylight (shadows, illuminated by ambient sky, surrounded by direct sunlight). This sensitivity would facilitate the extraction of shape-from-shadow signals to benefit global scene analysis and motion perception.
Collapse
|
8
|
Abstract
In this paper, we review the path taken by signals originating from the short wavelength sensitive cones (S-cones) in Old World and New World primates. Two types of retinal ganglion cells (RGCs) carrying S-cone signals (blue-On and blue-Off cells) project to the dorsal lateral geniculate nucleus (dLGN) in the thalamus. In all primates, these S-cone signals are relayed through the 'dust-like' (konis in classical Greek) dLGN cells. In New World primates such as common marmoset, these very small cells are known to form distinct and spatially extensive, koniocellular layers. Although in Old World primates, such as macaques, koniocellular layers tend to be very thin, the adjacent parvocellular layers contain distinct koniocellular extensions. It appears that all S-cone signals are relayed through such konio cells, whether they are in the main koniocellular layers or in their colonies within the parvocellular layers of the dLGN. In the primary visual cortex, these signals begin to merge with the signals carried by the other two principal parallel channels, namely the magnocellular and parvocellular channels. This article will also review the possible routes taken by the S-cone signals to reach one of the topographically organised extrastriate visual cortical areas, the middle temporal area (area MT). This area is the major conduit for signals reaching the parietal cortex. Alternative visual inputs to area MT not relayed via the primary visual cortex area (V1) may provide the neurological basis for the phenomenon of 'blindsight' observed in human and non-human primates, who have partial or complete damage to the primary visual cortex. Short wavelength sensitive cone (S-cone) signals to area MT may also play a role in directing visual attention with possible implications for understanding the pathology in dyslexia and some of its treatment options.
Collapse
Affiliation(s)
- Jaikishan Jayakumar
- Department of Optometry & Vision Sciences and Melbourne Brain Centre, The University of Melbourne, Parkville, Victoria, Australia
| | | | | |
Collapse
|
9
|
Jayakumar J, Roy S, Dreher B, Martin PR, Vidyasagar TR. Multiple pathways carry signals from short-wavelength-sensitive ('blue') cones to the middle temporal area of the macaque. J Physiol 2012; 591:339-52. [PMID: 23070701 DOI: 10.1113/jphysiol.2012.241117] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
We recorded spike activity of single neurones in the middle temporal visual cortical area (MT or V5) of anaesthetised macaque monkeys. We used flashing, stationary spatially circumscribed, cone-isolating and luminance-modulated stimuli of uniform fields to assess the effects of signals originating from the long-, medium- or short- (S) wavelength-sensitive cone classes. Nearly half (41/86) of the tested MT neurones responded reliably to S-cone-isolating stimuli. Response amplitude in the majority of the neurones tested further (19/28) was significantly reduced, though not always completely abolished, during reversible inactivation of visuotopically corresponding regions of the ipsilateral primary visual cortex (striate cortex, area V1). Thus, the present data indicate that signals originating in S-cones reach area MT, either via V1 or via a pathway that does not go through area V1. We did not find a significant difference between the mean latencies of spike responses of MT neurones to signals that bypass V1 and those that do not; the considerable overlap we observed precludes the use of spike-response latency as a criterion to define the routes through which the signals reach MT.
Collapse
Affiliation(s)
- Jaikishan Jayakumar
- Department of Optometry and Vision Sciences, The University of Melbourne, Parkville VIC 3010, Australia
| | | | | | | | | |
Collapse
|
10
|
A neuronal population measure of attention predicts behavioral performance on individual trials. J Neurosci 2010; 30:15241-53. [PMID: 21068329 DOI: 10.1523/jneurosci.2171-10.2010] [Citation(s) in RCA: 137] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Visual attention improves perception for an attended location or feature and also modulates the responses of sensory neurons. In laboratory studies, the sensory stimuli and task instructions are held constant within an attentional condition, but despite experimenters' best efforts, attention likely varies from moment to moment. Because most previous studies have focused on single neurons, it has been impossible to use neuronal responses to identify attentional fluctuations and determine whether these are associated with changes in behavior. We show that an instantaneous measure of attention based on the responses of a modest number of neurons in area V4 of the rhesus monkey (Macaca mulatta) can reliably predict large changes in an animal's ability to perform a difficult psychophysical task. Unexpectedly, this measure shows that the amount of attention allocated at any moment to locations in opposite hemifields is uncorrelated, suggesting that animals allocate attention to each stimulus independently rather than moving their attentional focus from one location to another.
Collapse
|
11
|
McKeefry DJ, Burton MP, Morland AB. The contribution of human cortical area V3A to the perception of chromatic motion: a transcranial magnetic stimulation study. Eur J Neurosci 2010; 31:575-84. [PMID: 20105228 DOI: 10.1111/j.1460-9568.2010.07095.x] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Area V3A was identified in five human subjects on both a functional and retinotopic basis using functional magnetic resonance imaging techniques. V3A, along with other visual areas responsive to motion, was then targeted for disruption by repetitive transcranial magnetic stimulation (rTMS) whilst the participants performed a delayed speed matching task. The stimuli used for this task included chromatic, isoluminant motion stimuli that activated either the L-M or S-(L+M) cone-opponent mechanisms, in addition to moving stimuli that contained only luminance contrast (L+M). The speed matching task was performed for chromatic and luminance stimuli that moved at slow (2 degrees/s) or faster (8 degrees/s) speeds. The application of rTMS to area V3A produced a perceived slowing of all chromatic and luminance stimuli at both slow and fast speeds. Similar deficits were found when rTMS was applied to V5/MT+. No deficits in performance were found when areas V3B and V3d were targeted by rTMS. These results provide evidence of a causal link between neural activity in human area V3A and the perception of chromatic isoluminant motion. They establish area V3A, alongside V5/MT+, as a key area in a cortical network that underpins the analysis of not only luminance but also chromatically-defined motion.
Collapse
Affiliation(s)
- D J McKeefry
- Bradford School of Optometry and Vision Science, University of Bradford, Bradford, W Yorks, UK.
| | | | | |
Collapse
|
12
|
Estimates of the contribution of single neurons to perception depend on timescale and noise correlation. J Neurosci 2009; 29:6635-48. [PMID: 19458234 DOI: 10.1523/jneurosci.5179-08.2009] [Citation(s) in RCA: 180] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The sensitivity of a population of neurons, and therefore the amount of sensory information available to an animal, is limited by the sensitivity of single neurons in the population and by noise correlation between neurons. For decades, therefore, neurophysiologists have devised increasingly clever and rigorous ways to measure these critical variables (Parker and Newsome, 1998). Previous studies examining the relationship between the responses of single middle temporal (MT) neurons and direction-discrimination performance uncovered an apparent paradox. Sensitivity measurements from single neurons suggested that small numbers of neurons may account for a monkey's psychophysical performance (Britten et al., 1992), but trial-to-trial variability in activity of single MT neurons are only weakly correlated with the monkey's behavior, suggesting that the monkey's decision must be based on the responses of many neurons (Britten et al., 1996). We suggest that the resolution to this paradox lies (1) in the long stimulus duration used in the original studies, which led to an overestimate of neural sensitivity relative to psychophysical sensitivity, and (2) mistaken assumptions (because no data were available) about the level of noise correlation in MT columns with opposite preferred directions. We therefore made new physiological and psychophysical measurements in a reaction time version of the direction-discrimination task that matches neural measurements to the actual decision time of the animals. These new data, considered together with our recent data on noise correlation in MT (Cohen and Newsome, 2008), provide a substantially improved account of psychometric performance in the direction-discrimination task.
Collapse
|
13
|
The perception of speed based on L-M and S-(L+M) cone opponent processing. Vision Res 2009; 49:870-6. [PMID: 19285523 DOI: 10.1016/j.visres.2009.03.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2008] [Revised: 03/04/2009] [Accepted: 03/05/2009] [Indexed: 11/20/2022]
Abstract
We have measured perceived speed and speed discrimination thresholds for stimuli that selectively activate the L-M, S-(L+M) cone opponent and L+M (luminance) post-receptoral pathways. For low speeds and low contrasts speed discrimination thresholds for L-M and S-(L+M) are similar but are higher and have a greater dependency upon contrast than those for luminance motion. These differences between chromatic and luminance speed perception can be eliminated when stimuli are equated with respect to their individual motion detection thresholds (MDTs). For fast moving gratings speed perception based upon L-M, S-(L+M) and L+M signals is similar in terms of threshold performance and contrast dependency. These results are consistent with the view that there are separate mechanisms for the analysis of chromatic and luminance motion, the relative contributions of which may change as a function of stimulus contrast and speed. The similarity in performance for S-(L+M) and L+M chromatic stimuli across a range of stimulus parameters suggests that signals derived from the two cone opponent pathways can be used equally well. Our results argue against the idea that speed perception is compromised when it is based upon information derived from the S-(L+M) cone opponent pathway.
Collapse
|
14
|
Shipp S, Adams DL, Moutoussis K, Zeki S. Feature binding in the feedback layers of area V2. ACTA ACUST UNITED AC 2009; 19:2230-9. [PMID: 19153106 DOI: 10.1093/cercor/bhn243] [Citation(s) in RCA: 49] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
The visual features of an object are processed by multiple, functionally specialized areas of cerebral cortex. When several objects are seen simultaneously, what mechanism preserves the association of features that belong to a single item? We address this question-known as the "binding problem"-by examining combinatorial feature selectivity of neurons in area V2. In recording from anesthetized macaques, we estimate that dual selectivity for chromatic and spatiotemporal attributes is 50% more common (27% vs. 18% sampling frequency) in superficial and deep layer neurons receiving feedback connections from higher areas, compared with layer 4-3 neurons relaying ascending signals. The operation of feedback pathways is thought to mediate attentional modulation of activity that may achieve binding through acting to select one single object for higher representation and filtering out competing objects. We propose that dual-selective neurons perform a "bridging" function, mediating the transfer of feedback-induced bias between feature dimensions. The bias can be propagated through V2 output neurons (of unitary selectivity) to higher levels of specialized processing and so promote selection of the target object's representation among multiple feature maps. The bridging function would thus act to unify the outcome of parallel, object-selective processes taking place along segregated visual pathways.
Collapse
Affiliation(s)
- Stewart Shipp
- Laboratory of Neurobiology, Department of Cell and Developmental Biology, University College London, London, UK.
| | | | | | | |
Collapse
|
15
|
Context-dependent changes in functional circuitry in visual area MT. Neuron 2008; 60:162-73. [PMID: 18940596 DOI: 10.1016/j.neuron.2008.08.007] [Citation(s) in RCA: 172] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2007] [Revised: 08/05/2008] [Accepted: 08/06/2008] [Indexed: 01/22/2023]
Abstract
Animals can flexibly change their behavior in response to a particular sensory stimulus; the mapping between sensory and motor representations in the brain must therefore be flexible as well. Changes in the correlated firing of pairs of neurons may provide a metric of changes in functional circuitry during behavior. We studied dynamic changes in functional circuitry by analyzing the noise correlations of simultaneously recorded MT neurons in two behavioral contexts: one that promotes cooperative interactions between the two neurons and another that promotes competitive interactions. We found that identical visual stimuli give rise to differences in noise correlation in the two contexts, suggesting that MT neurons receive inputs of central origin whose strength changes with the task structure. The data are consistent with a mixed feature-based attentional strategy model in which the animal sometimes alternates attention between opposite directions of motion and sometimes attends to the two directions simultaneously.
Collapse
|
16
|
Hashemi-Nezhad M, Blessing EM, Dreher B, Martin PR. Segregation of short-wavelength sensitive (“blue”) cone signals among neurons in the lateral geniculate nucleus and striate cortex of marmosets. Vision Res 2008; 48:2604-14. [DOI: 10.1016/j.visres.2008.02.017] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2007] [Revised: 02/14/2008] [Accepted: 02/15/2008] [Indexed: 11/25/2022]
|
17
|
Wade A, Augath M, Logothetis N, Wandell B. fMRI measurements of color in macaque and human. J Vis 2008; 8:6.1-19. [PMID: 19146348 DOI: 10.1167/8.10.6] [Citation(s) in RCA: 54] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2008] [Accepted: 07/17/2008] [Indexed: 11/24/2022] Open
Abstract
We have used fMRI to measure responses to chromatic and achromatic contrast in retinotopically defined regions of macaque and human visual cortex. We make four observations. Firstly, the relative amplitudes of responses to color and luminance stimuli in macaque area V1 are similar to those previously observed in human fMRI experiments. Secondly, the dorsal and ventral subdivisions of macaque area V4 respond in a similar way to opponent (L--M)-cone chromatic contrast suggesting that they are part of a single functional area. Thirdly, we find that macaque area V4, like area V1, responds preferentially to chromatic contrast compared to luminance contrast and the degree of preference is strongly influenced by the temporal frequency of the stimulus. Finally, we observe that while macaque V4d is a region on the dorsal surface of the macaque visual cortex that responds robustly to chromatic stimuli, human chromatic responses to identical stimuli are largely confined to the ventral surface suggesting a fundamental difference in the topographical organization of higher visual areas between humans and macaques.
Collapse
Affiliation(s)
- Alex Wade
- Smith-Kettlewell Eye Research Center, San Francisco, CA, USA.
| | | | | | | |
Collapse
|
18
|
Affiliation(s)
- Steven K. Shevell
- Departments of Psychology and Ophthalmology & Visual Science, University of Chicago, Chicago, Illinois 60637
| | | |
Collapse
|
19
|
Burton MP, McKeefry DJ. Misperceptions of speed for chromatic and luminance grating stimuli. Vision Res 2007; 47:1504-17. [PMID: 17395238 DOI: 10.1016/j.visres.2006.12.020] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2006] [Revised: 12/14/2006] [Accepted: 12/22/2006] [Indexed: 11/24/2022]
Abstract
Errors in the perception of speed of moving visual stimuli can occur when presented stimuli are of unequal contrast and when they appear alongside additional modifier stimuli that move at different speeds. We have examined these misperceptions for chromatic and luminance grating stimuli in order to assess to what extent these different kinds of motion cue might be utilised in the analysis of speed of moving objects. We show that the dependence on contrast of speed matching for luminance and chromatic stimuli is similar over a range of stimulus speeds greater than 4 deg/s. Differences between the contrast dependencies of speed perception for chromatic and luminance stimuli are only evident at slow speeds (< 4 deg/s) and low contrasts. The presence of modifier stimuli can directly influence the perceived speed at both high and low velocities and contrasts. This influence was found to be independent of the modifiers' chromaticity and was greatest when the modifiers were adjacent to and presented simultaneously with the test and reference stimuli. However, the modifiers were still able to induce measurable changes in perceived speed for increased separations over space and time. Taken together these results indicate that whilst differences do exist in the contrast dependencies of speed perception for chromatic and luminance stimuli, they are evident only for a narrow range of stimulus parameters (i.e. low speed and low contrast). There appears to be ample scope for interactions between chromatic and luminance contrast in speed perception where there is the capacity to pool this information over a relatively broad spatio-temporal extent.
Collapse
Affiliation(s)
- M P Burton
- Department of Optometry, University of Bradford, Bradford BD7 1DP, UK
| | | |
Collapse
|
20
|
Abstract
Our ability to coordinate the use of our left and right eyes and to make use of subtle differences between the images received by each eye allows us to perceive stereoscopic depth, which is important for the visual perception of three-dimensional space. Binocular neurons in the visual cortex combine signals from the left and right eyes. Probing the roles of binocular neurons in different perceptual tasks has advanced our understanding of the stages within the visual cortex that lead to binocular depth perception.
Collapse
Affiliation(s)
- Andrew J Parker
- Department of Physiology, Anatomy and Genetics, Sherrington Building, Parks Road, Oxford, OX1 3PT, UK.
| |
Collapse
|
21
|
Ruppertsberg AI, Wuerger SM, Bertamini M. When S-cones contribute to chromatic global motion processing. Vis Neurosci 2007; 24:1-8. [PMID: 17430604 DOI: 10.1017/s0952523807230081] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2005] [Accepted: 04/25/2006] [Indexed: 11/07/2022]
Abstract
There is common consensus now that color-defined motion can be perceived by the human visual system. For global motion integration tasks based on isoluminant random dot kinematograms conflicting evidence exists, whether observers can (Ruppertsberg et al., 2003) or cannot (Bilodeau & Faubert, 1999) extract a common motion direction for stimuli modulated along the isoluminant red-green axis. Here we report conditions, in which S-cones contribute to chromatic global motion processing. When the display included extra-foveal regions, the individual elements were large (∼0.3°) and the displacement was large (∼1°), stimuli modulated along the yellowish-violet axis proved to be effective in a global motion task. The color contrast thresholds for detection for both color axes were well below the contrasts required for global motion integration, and therefore the discrimination-to-detection ratio was >1. We conclude that there is significant S-cone input to chromatic global motion processing and the extraction of global motion is not mediated by the same mechanism as simple detection. Whether the koniocellular or the magnocellular pathway is involved in transmitting S-cone signals is a topic of current debate (Chatterjee & Callaway, 2002).
Collapse
Affiliation(s)
- Alexa I Ruppertsberg
- Department of Psychology, University of Liverpool, Eleanor Rathbone Building, Liverpool, United Kingdom.
| | | | | |
Collapse
|
22
|
Horwitz GD, Chichilnisky EJ, Albright TD. Cone Inputs to Simple and Complex Cells in V1 of Awake Macaque. J Neurophysiol 2007; 97:3070-81. [PMID: 17303812 DOI: 10.1152/jn.00965.2006] [Citation(s) in RCA: 46] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Rules by which V1 neurons combine signals originating in the cone photoreceptors are poorly understood. We measured cone inputs to V1 neurons in awake, fixating monkeys with white-noise analysis techniques that reveal properties of light responses not revealed by purely linear models used in previous studies. Simple cells were studied by spike-triggered averaging that is robust to static nonlinearities in spike generation. This analysis revealed, among heterogeneously tuned neurons, two relatively discrete categories: one with opponent L- and M-cone weights and another with nonopponent cone weights. Complex cells were studied by spike-triggered covariance, which identifies features in the stimulus sequence that trigger spikes in neurons with receptive fields containing multiple linear subunits that combine nonlinearly. All complex cells responded to nonopponent stimulus modulations. Although some complex cells responded to cone-opponent stimulus modulations too, none exhibited the pure opponent sensitivity observed in many simple cells. These results extend the findings on distinctions between simple and complex cell chromatic tuning observed in previous studies in anesthetized monkeys.
Collapse
Affiliation(s)
- Gregory D Horwitz
- Vision Center Laboratory, The Salk Institute for Biological Studies, La Jolla, California, USA.
| | | | | |
Collapse
|
23
|
Michna ML, Yoshizawa T, Mullen KT. S-cone contributions to linear and non-linear motion processing. Vision Res 2007; 47:1042-54. [PMID: 17343890 DOI: 10.1016/j.visres.2007.01.014] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2006] [Revised: 12/21/2006] [Accepted: 01/25/2007] [Indexed: 11/30/2022]
Abstract
We investigated the characteristics of mechanisms mediating motion discrimination of S-cone isolating stimuli and found a double dissociation between the effects of luminance noise, which masks linear but not non-linear motion, and chromatic noise, which masks non-linear but not linear motion. We conclude that S-cones contribute to motion via two different pathways: a non-linear motion mechanism via a chromatic pathway and a linear motion mechanism via a luminance pathway. Additionally, motion discrimination and detection thresholds for drifting, S-cone isolating Gabors are unaffected by luminance noise, indicating that grating motion is mediated via chromatic mechanisms and based on higher-order motion processing.
Collapse
Affiliation(s)
- Magda L Michna
- Department of Ophthalmology, McGill Vision Research, McGill University, Montreal, Que., Canada H3A 1A1.
| | | | | |
Collapse
|
24
|
Chase C, Dougherty RF, Ray N, Fowler S, Stein J. L/M Speed-Matching Ratio Predicts Reading in Children. Optom Vis Sci 2007; 84:229-36. [PMID: 17435537 DOI: 10.1097/opx.0b013e31803399df] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
PURPOSE Many behavioral studies have found impaired perception of dynamic visual stimuli in dyslexia and several neuroimaging studies have found reduced activation of the human motion area MT+ in dyslexia. These results are often interpreted as a magnocellular (MC) deficit in dyslexia. It has also been claimed that colored filters can help dyslexics to read. One defining feature of the MC-pathway is a greater weight for L-cone input than M-cone input, and at most very weak S-cone input. We measured the subjective speed matches between L-, M-, and S-cone isolating stimuli in good and poor readers. METHODS Subjects performed a speed-matching task with drifting cone-isolating stimuli to find the point of subjective equality between two drifting patterns. Such a task is known to activate cortical area MT+, presumably via the MC-pathway. RESULTS L- to M-cone speed-match ratios were negatively correlated with single-word (r=-0.46) and irregular-word reading (r=-0.56) but not with non-word reading. CONCLUSIONS Results suggest that relative L-cone sensitivity within the MC-pathway may limit orthographic reading performance.
Collapse
Affiliation(s)
- Chris Chase
- Department of Psychology, Claremont McKenna College, Claremont, California 91711, USA.
| | | | | | | | | |
Collapse
|
25
|
Liu J, Newsome WT. Local field potential in cortical area MT: stimulus tuning and behavioral correlations. J Neurosci 2006; 26:7779-90. [PMID: 16870724 PMCID: PMC6674213 DOI: 10.1523/jneurosci.5052-05.2006] [Citation(s) in RCA: 279] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Low-frequency electrical signals like those that compose the local field potential (LFP) can be detected at substantial distances from their point of origin within the brain. It is thus unclear how useful the LFP might be for assessing local function, for example, on the spatial scale of cortical columns. We addressed this problem by comparing speed and direction tuning of LFPs obtained from middle temporal area MT with the tuning of multiunit (MU) activity recorded simultaneously. We found that the LFP can be well tuned for speed and direction and is highly correlated with that of MU activity, particularly for frequencies at and above the gamma band. LFP tuning is substantially poorer for lower frequencies, although tuning for direction extends to lower frequencies than does tuning for speed. Our data suggest that LFP signals at and above the gamma band reflect neural processing on the spatial scale of cortical columns, within a few hundred micrometers of the electrode tip. Consistent with this notion, we also found that frequencies at and above the gamma band measured during a speed discrimination task exhibit an effect known as "choice probability," which reveals a particularly close relationship between neural activity and behavioral choices. In the LFP, this signature of the perceptual choice comprises a shift in relative power from low-frequency bands (alpha and beta) to the gamma band. It remains to be determined how LFP choice probability, which is a temporal signature, is related to conventional choice probability effects observed in spike rates.
Collapse
Affiliation(s)
- Jing Liu
- Howard Hughes Medical Institute and Department of Neurobiology, Stanford University School of Medicine, Stanford, California 94305-5125, USA.
| | | |
Collapse
|
26
|
Abstract
The issue of whether there is a motion mechanism sensitive to purely chromatic stimuli has been pertinent for the past 30 or more years. The aim of this review is to examine why such different conclusions have been drawn in the literature and to reach some reconciliation. The review critically examines the behavioral evidence and concludes that there is a purely chromatic motion mechanism but that it is limited to the fovea. Examination of motion performance for chromatic and luminance stimuli provides convincing evidence that there are at least two different mechanisms for the two kinds of stimuli. The authors further argue that the chromatic mechanism may be at a particular disadvantage when the integration of multiple local motion signals is required. Finally, the authors present a descriptive model that may go some way toward explaining the reasons for the differences in collected data outlined in this article.
Collapse
|