1
|
Ju NS, Guan SC, Tang SM, Yu C. Macaque V1 responses to 2nd-order contrast-modulated stimuli and the possible subcortical and cortical contributions. Prog Neurobiol 2022; 217:102315. [PMID: 35809761 DOI: 10.1016/j.pneurobio.2022.102315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 07/01/2022] [Accepted: 07/05/2022] [Indexed: 12/01/2022]
Abstract
Natural images comprise contours and boundaries defined by 1st-order luminance-modulated (LM) cues that are readily encoded by V1 neurons, and 2nd-order contrast-modulated (CM) cues that carry local, but not over-the-space, luminance changes. The neurophysiological foundations for CM processing remain unsolved. Here we used two-photon calcium imaging to demonstrate that V1 superficial-layer neurons respond to both LM and CM gratings in awake, fixating, macaques, with overall LM responses stronger than CM responses. Furthermore, adaptation experiments revealed that LM responses were similarly suppressed by LM and CM adaptation, with moderately larger effects by iso-orientation adaptation than by orthogonal adaptation, suggesting that LM and CM orientation responses likely share a strong orientation-non-selective subcortical origin. In contrast, CM responses were substantially more suppressed by iso-orientation than by orthogonal LM and CM adaptation, likely suggesting stronger orientation-specific intracortical influences for CM responses than for LM responses, besides shared orientation-non-selective subcortical influences. These results thus may indicate a subcortical-to-V1 filter-rectify-filter mechanism for CM processing: Local luminance changes in CM stimuli are initially encoded by orientation-non-selective subcortical neurons, and the outputs are half-wave rectified, and then summed by V1 neurons to signal CM orientation, which may be further substantially refined by intracortical influences.
Collapse
Affiliation(s)
- Nian-Sheng Ju
- School of Life Sciences, Peking University, Beijing, China
| | - Shu-Chen Guan
- PKU-Tsinghua Center for Life Sciences, Peking University, Beijing, China
| | - Shi-Ming Tang
- School of Life Sciences, Peking University, Beijing, China; PKU-Tsinghua Center for Life Sciences, Peking University, Beijing, China; IDG-McGovern Institute for Brain Research, Peking University, Beijing, China.
| | - Cong Yu
- PKU-Tsinghua Center for Life Sciences, Peking University, Beijing, China; IDG-McGovern Institute for Brain Research, Peking University, Beijing, China; School of Psychological and Cognitive Sciences, Peking University, Beijing, China.
| |
Collapse
|
2
|
Wang BS, Bernardez Sarria MS, An X, He M, Alam NM, Prusky GT, Crair MC, Huang ZJ. Retinal and Callosal Activity-Dependent Chandelier Cell Elimination Shapes Binocularity in Primary Visual Cortex. Neuron 2021; 109:502-515.e7. [PMID: 33290732 PMCID: PMC7943176 DOI: 10.1016/j.neuron.2020.11.004] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Revised: 09/23/2020] [Accepted: 11/04/2020] [Indexed: 12/21/2022]
Abstract
In mammals with binocular vision, integration of the left and right visual scene relies on information in the center visual field, which are relayed from each retina in parallel and merge in the primary visual cortex (V1) through the convergence of ipsi- and contralateral geniculocortical inputs as well as transcallosal projections between two visual cortices. The developmental assembly of this binocular circuit, especially the transcallosal pathway, remains incompletely understood. Using genetic methods in mice, we found that several days before eye-opening, retinal and callosal activities drive massive apoptosis of GABAergic chandelier cells (ChCs) in the binocular region of V1. Blockade of ChC elimination resulted in a contralateral eye-dominated V1 and deficient binocular vision. As pre-vision retinal activities convey the left-right organization of the visual field, their regulation of ChC density through the transcallosal pathway may prime a nascent binocular territory for subsequent experience-driven tuning during the post-vision critical period.
Collapse
Affiliation(s)
- Bor-Shuen Wang
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Maria Sol Bernardez Sarria
- Department of Neuroscience, Yale University School of Medicine, New Haven, CT, USA; Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA
| | - Xu An
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Miao He
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA; Institutes of Brain Science, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China
| | - Nazia M Alam
- The Burke Neurological Institute, White Plains, NY 10605, USA; Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA
| | - Glen T Prusky
- The Burke Neurological Institute, White Plains, NY 10605, USA; Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA
| | - Michael C Crair
- Department of Neuroscience, Yale University School of Medicine, New Haven, CT, USA
| | - Z Josh Huang
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA; Department of Neurobiology, Duke University Medical Center, Durham, NC, USA.
| |
Collapse
|
3
|
Skerswetat J, Formankiewicz MA, Waugh SJ. Contrast-modulated stimuli produce more superimposition and predominate perception when competing with comparable luminance-modulated stimuli during interocular grouping. Sci Rep 2020; 10:13409. [PMID: 32770074 PMCID: PMC7414227 DOI: 10.1038/s41598-020-69527-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Accepted: 07/13/2020] [Indexed: 11/08/2022] Open
Abstract
Interocular grouping (IOG) is a binocular visual function that can arise during multi-stable perception. IOG perception was initiated using split-grating stimuli constructed from luminance (L), luminance-modulated noise (LM) and contrast-modulated noise (CM). In Experiment 1, three different visibility levels were used for L and LM (or first-order) stimuli, and compared to fixed-visibility CM (or second-order) stimuli. Eight binocularly normal participants indicated whether they perceived full horizontal or vertical gratings, superimposition, or other (piecemeal and eye-of-origin) percepts. CM stimuli rarely generated full IOG, but predominantly generated superimposition. In Experiment 2, Levelt's modified laws were tested for IOG in nine participants. Split-gratings presented to each eye contained different visibility LM gratings, or LM and CM gratings. The results for the LM-vs-LM conditions mostly followed the predictions of Levelt's modified laws, whereas the results for the LM-vs-CM conditions did not. Counterintuitively, when high-visibility LM and low-visibility CM split-gratings were used, high-visibility LM components did not predominate IOG perception. Our findings suggest that higher proportions of superimposition during CM-vs-CM viewing are due to binocular combination, rather than mutual inhibition. It implies that IOG percepts are more likely to be mediated at an earlier monocular, rather than a binocular stage. Our previously proposed conceptual framework for conventional binocular rivalry, which includes asymmetric feedback, visual saliency, or a combination of both (Skerswetat et al. Sci Rep 8:14432, 2018), might also account for IOG. We speculate that opponency neurons might mediate coherent percepts when dissimilar information separately enters the eyes.
Collapse
Affiliation(s)
- Jan Skerswetat
- Department of Vision and Hearing Sciences, Anglia Vision Research, Anglia Ruskin University, East Road, Cambridge, CB1 1PT, UK.
- Department of Psychology, Northeastern University, 360 Huntington Ave, Boston, MA, 02115, USA.
| | - Monika A Formankiewicz
- Department of Vision and Hearing Sciences, Anglia Vision Research, Anglia Ruskin University, East Road, Cambridge, CB1 1PT, UK
| | - Sarah J Waugh
- Department of Vision and Hearing Sciences, Anglia Vision Research, Anglia Ruskin University, East Road, Cambridge, CB1 1PT, UK
| |
Collapse
|
4
|
Skerswetat J, Formankiewicz MA, Waugh SJ. Levelt's laws do not predict perception when luminance- and contrast-modulated stimuli compete during binocular rivalry. Sci Rep 2018; 8:14432. [PMID: 30258060 PMCID: PMC6158271 DOI: 10.1038/s41598-018-32703-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 08/22/2018] [Indexed: 11/08/2022] Open
Abstract
Incompatible patterns viewed by each of the two eyes can provoke binocular rivalry, a competition of perception. Levelt's first law predicts that a highly visible stimulus will predominate over a less visible stimulus during binocular rivalry. In a behavioural study, we made a counterintuitive observation: high visibility patterns do not always predominate over low visibility patterns. Our results show that none of Levelt's binocular rivalry laws hold when luminance-modulated (LM) patterns compete with contrast-modulated (CM) patterns. We discuss visual saliency, asymmetric feedback, and a combination of both as potential mechanisms to explain the CM versus LM findings. Competing orthogonal LM stimuli do follow Levelt's laws, whereas only the first two laws hold for competing CM stimuli. The current results provide strong psychophysical evidence for the existence of separate processing stages for LM and CM stimuli.
Collapse
Affiliation(s)
- Jan Skerswetat
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT, Cambridge, UK.
| | - Monika A Formankiewicz
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT, Cambridge, UK
| | - Sarah J Waugh
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT, Cambridge, UK
| |
Collapse
|
5
|
Milleret C, Bui Quoc E. Beyond Rehabilitation of Acuity, Ocular Alignment, and Binocularity in Infantile Strabismus. Front Syst Neurosci 2018; 12:29. [PMID: 30072876 PMCID: PMC6058758 DOI: 10.3389/fnsys.2018.00029] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2017] [Accepted: 06/15/2018] [Indexed: 11/13/2022] Open
Abstract
Infantile strabismus impairs the perception of all attributes of the visual scene. High spatial frequency components are no longer visible, leading to amblyopia. Binocularity is altered, leading to the loss of stereopsis. Spatial perception is impaired as well as detection of vertical orientation, the fastest movements, directions of movement, the highest contrasts and colors. Infantile strabismus also affects other vision-dependent processes such as control of postural stability. But presently, rehabilitative therapies for infantile strabismus by ophthalmologists, orthoptists and optometrists are restricted to preventing or curing amblyopia of the deviated eye, aligning the eyes and, whenever possible, preserving or restoring binocular vision during the critical period of development, i.e., before ~10 years of age. All the other impairments are thus ignored; whether they may recover after strabismus treatment even remains unknown. We argue here that medical and paramedical professionals may extend their present treatments of the perceptual losses associated with infantile strabismus. This hypothesis is based on findings from fundamental research on visual system organization of higher mammals in particular at the cortical level. In strabismic subjects (as in normal-seeing ones), information about all of the visual attributes converge, interact and are thus inter-dependent at multiple levels of encoding ranging from the single neuron to neuronal assemblies in visual cortex. Thus if the perception of one attribute is restored this may help to rehabilitate the perception of other attributes. Concomitantly, vision-dependent processes may also improve. This could occur spontaneously, but still should be assessed and validated. If not, medical and paramedical staff, in collaboration with neuroscientists, will have to break new ground in the field of therapies to help reorganize brain circuitry and promote more comprehensive functional recovery. Findings from fundamental research studies in both young and adult patients already support our hypothesis and are reviewed here. For example, presenting different contrasts to each eye of a strabismic patient during training sessions facilitates recovery of acuity in the amblyopic eye as well as of 3D perception. Recent data also demonstrate that visual recoveries in strabismic subjects improve postural stability. These findings form the basis for a roadmap for future research and clinical development to extend presently applied rehabilitative therapies for infantile strabismus.
Collapse
Affiliation(s)
- Chantal Milleret
- Center for Interdisciplinary Research in Biology, Centre National de la Recherche Scientifique, College de France, INSERM, PSL Research University, Paris, France
| | - Emmanuel Bui Quoc
- Department of Ophthalmology, Robert Debré University Hospital, Assistance Publique - Hôpitaux de Paris Paris, France
| |
Collapse
|
6
|
Lu Y, Yin J, Chen Z, Gong H, Liu Y, Qian L, Li X, Liu R, Andolina IM, Wang W. Revealing Detail along the Visual Hierarchy: Neural Clustering Preserves Acuity from V1 to V4. Neuron 2018; 98:417-428.e3. [PMID: 29606580 DOI: 10.1016/j.neuron.2018.03.009] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Revised: 02/06/2018] [Accepted: 03/05/2018] [Indexed: 11/20/2022]
Abstract
How primates perceive objects along with their detailed features remains a mystery. This ability to make fine visual discriminations depends upon a high-acuity analysis of spatial frequency (SF) along the visual hierarchy from V1 to inferotemporal cortex. By studying the transformation of SF across macaque parafoveal V1, V2, and V4, we discovered SF-selective functional domains in V4 encoding higher SFs up to 12 cycles/°. These intermittent higher-SF-selective domains, surrounded by domains encoding lower SFs, violate the inverse relationship between SF preference and retinal eccentricity. The neural activities of higher- and lower-SF domains correspond to local and global features, respectively, of the same stimuli. Neural response latencies in high-SF domains are around 10 ms later than in low-SF domains, consistent with the coarse-to-fine nature of perception. Thus, our finding of preserved resolution from V1 into V4, separated both spatially and temporally, may serve as a connecting link for detailed object representation.
Collapse
|
7
|
Skerswetat J, Formankiewicz MA, Waugh SJ. More superimposition for contrast-modulated than luminance-modulated stimuli during binocular rivalry. Vision Res 2017; 142:40-51. [PMID: 29102622 DOI: 10.1016/j.visres.2017.10.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2016] [Revised: 08/08/2017] [Accepted: 10/18/2017] [Indexed: 10/18/2022]
Abstract
Luminance-modulated noise (LM) and contrast-modulated noise (CM) gratings were presented with interocularly correlated, uncorrelated and anti-correlated binary noise to investigate their contributions to mixed percepts, specifically piecemeal and superimposition, during binocular rivalry. Stimuli were sine-wave gratings of 2 c/deg presented within 2 deg circular apertures. The LM stimulus contrast was 0.1 and the CM stimulus modulation depth was 1.0, equating to approximately 5 and 7 times detection threshold, respectively. Twelve 45 s trials, per noise configuration, were carried out. Fifteen participants with normal vision indicated via button presses whether an exclusive, piecemeal or superimposed percept was seen. For all noise conditions LM stimuli generated more exclusive visibility, and lower proportions of superimposition. CM stimuli led to greater proportions and longer periods of superimposition. For both stimulus types, correlated interocular noise generated more superimposition than did anti- or uncorrelated interocular noise. No significant effect of stimulus type (LM vs CM) or noise configuration (correlated, uncorrelated, anti-correlated) on piecemeal perception was found. Exclusive visibility was greater in proportion, and perceptual changes more numerous, during binocular rivalry for CM stimuli when interocular noise was not correlated. This suggests that mutual inhibition, initiated by non-correlated noise CM gratings, occurs between neurons processing luminance noise (first-order component), as well as those processing gratings (second-order component). Therefore, first- and second-order components can contribute to overall binocular rivalry responses. We suggest the addition of a new well to the current energy landscape model for binocular rivalry that takes superimposition into account.
Collapse
Affiliation(s)
- Jan Skerswetat
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT Cambridge, UK.
| | - Monika A Formankiewicz
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT Cambridge, UK
| | - Sarah J Waugh
- Anglia Vision Research, Department of Vision and Hearing Sciences, Anglia Ruskin University, East Road, CB1 1PT Cambridge, UK
| |
Collapse
|
8
|
Zhang J, Zhang X, Hu X, Wu W, Yang Y. Organization of spatial frequency in cat striate cortex. Neuroscience 2017; 362:95-103. [PMID: 28823818 DOI: 10.1016/j.neuroscience.2017.08.021] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2017] [Revised: 08/09/2017] [Accepted: 08/09/2017] [Indexed: 11/30/2022]
Abstract
Primary visual cortex, the first cortical stage of visual information processing, is represented by diverse functional maps that demonstrate the selectivity for specific visual features such as spatial frequency (SF). Although the local organization of SF maps in cat area 17 (A17) has been largely investigated, the global arrangement remains elusive. To address this unclear aspect, we evaluated the organization of SF maps within A17 by intrinsic signal optical imaging and extracellular electrophysiological recording. Our results explicitly showed that SF organization in cat A17 displayed a global asymmetrical unimodal distribution. In particular, we found the highest SF preference within the global distribution concentrated around the horizontal meridian. These results significantly contribute to a more comprehensive understanding of the SF organization in visual cortex.
Collapse
Affiliation(s)
- Jingjing Zhang
- CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, University of Science and Technology of China, Hefei 230027, PR China
| | - Xian Zhang
- CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, University of Science and Technology of China, Hefei 230027, PR China
| | - Xu Hu
- CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, University of Science and Technology of China, Hefei 230027, PR China
| | - Wei Wu
- CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, University of Science and Technology of China, Hefei 230027, PR China
| | - Yupeng Yang
- CAS Key Laboratory of Brain Function and Disease, School of Life Sciences, University of Science and Technology of China, Hefei 230027, PR China.
| |
Collapse
|
9
|
Sawada T, Petrov AA. The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions. J Neurophysiol 2017; 118:3051-3091. [PMID: 28835531 DOI: 10.1152/jn.00821.2016] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2016] [Revised: 08/21/2017] [Accepted: 08/21/2017] [Indexed: 01/24/2023] Open
Abstract
The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.
Collapse
Affiliation(s)
- Tadamasa Sawada
- School of Psychology, National Research University Higher School of Economics, Moscow, Russia; and
| | | |
Collapse
|
10
|
Gharat A, Baker CL Jr. Nonlinear Y-Like Receptive Fields in the Early Visual Cortex: An Intermediate Stage for Building Cue-Invariant Receptive Fields from Subcortical Y Cells. J Neurosci 2017; 37:998-1013. [PMID: 28123031 DOI: 10.1523/JNEUROSCI.2120-16.2016] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2016] [Revised: 11/21/2016] [Accepted: 12/12/2016] [Indexed: 11/21/2022] Open
Abstract
Many of the neurons in early visual cortex are selective for the orientation of boundaries defined by first-order cues (luminance) as well as second-order cues (contrast, texture). The neural circuit mechanism underlying this selectivity is still unclear, but some studies have proposed that it emerges from spatial nonlinearities of subcortical Y cells. To understand how inputs from the Y-cell pathway might be pooled to generate cue-invariant receptive fields, we recorded visual responses from single neurons in cat Area 18 using linear multielectrode arrays. We measured responses to drifting and contrast-reversing luminance gratings as well as contrast modulation gratings. We found that a large fraction of these neurons have nonoriented responses to gratings, similar to those of subcortical Y cells: they respond at the second harmonic (F2) to high-spatial frequency contrast-reversing gratings and at the first harmonic (F1) to low-spatial frequency drifting gratings ("Y-cell signature"). For a given neuron, spatial frequency tuning for linear (F1) and nonlinear (F2) responses is quite distinct, similar to orientation-selective cue-invariant neurons. Also, these neurons respond to contrast modulation gratings with selectivity for the carrier (texture) spatial frequency and, in some cases, orientation. Their receptive field properties suggest that they could serve as building blocks for orientation-selective cue-invariant neurons. We propose a circuit model that combines ON- and OFF-center cortical Y-like cells in an unbalanced push-pull manner to generate orientation-selective, cue-invariant receptive fields. SIGNIFICANCE STATEMENT A significant fraction of neurons in early visual cortex have specialized receptive fields that allow them to selectively respond to the orientation of boundaries that are invariant to the cue (luminance, contrast, texture, motion) that defines them. However, the neural mechanism to construct such versatile receptive fields remains unclear. Using multielectrode recording, we found a large fraction of neurons in early visual cortex with receptive fields not selective for orientation that have spatial nonlinearities like those of subcortical Y cells. These are strong candidates for building cue-invariant orientation-selective neurons; we present a neural circuit model that pools such neurons in an imbalanced "push-pull" manner, to generate orientation-selective cue-invariant receptive fields.
Collapse
|
11
|
Khastkhodaei Z, Jurjut O, Katzner S, Busse L. Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception. J Neurosci 2016; 36:4457-69. [PMID: 27098690 DOI: 10.1523/JNEUROSCI.4595-15.2016] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2015] [Accepted: 02/23/2016] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Visual processing along the primate ventral stream takes place in a hierarchy of areas, characterized by an increase in both complexity of neuronal preferences and invariance to changes of low-level stimulus attributes. A basic type of invariance is form-cue invariance, where neurons have similar preferences in response to first-order stimuli, defined by changes in luminance, and global features of second-order stimuli, defined by changes in texture or contrast. Whether in mice, a now popular model system for early visual processing, visual perception can be guided by second-order stimuli is currently unknown. Here, we probed mouse visual perception and neural responses in areas V1 and LM using various types of second-order, contrast-modulated gratings with static noise carriers. These gratings differ in their spatial frequency composition and thus in their ability to invoke first-order mechanisms exploiting local luminance features. We show that mice can transfer learning of a coarse orientation discrimination task involving first-order, luminance-modulated gratings to the contrast-modulated gratings, albeit with markedly reduced discrimination performance. Consistent with these behavioral results, we demonstrate that neurons in area V1 and LM are less responsive and less selective to contrast-modulated than to luminance-modulated gratings, but respond with broadly similar preferred orientations. We conclude that mice can, at least in a rudimentary form, use second-order stimuli to guide visual perception. SIGNIFICANCE STATEMENT To extract object boundaries in natural scenes, the primate visual system does not only rely on differences in local luminance but can also take into account differences in texture or contrast. Whether the mouse, which has a much simpler visual system, can use such second-order information to guide visual perception is unknown. Here we tested mouse perception of second-order, contrast-defined stimuli and measured their neural representations in two areas of visual cortex. We find that mice can use contrast-defined stimuli to guide visual perception, although behavioral performance and neural representations were less robust than for luminance-defined stimuli. These findings shed light on basic steps of feature extraction along the mouse visual cortical hierarchy, which may ultimately lead to object recognition.
Collapse
|
12
|
Abstract
Primates need to detect and recognize camouflaged animals in natural environments. Camouflage-breaking movements are often the only visual cue available to accomplish this. Specifically, sudden movements are often detected before full recognition of the camouflaged animal is made, suggesting that initial processing of motion precedes the recognition of motion-defined contours or shapes. What are the neuronal mechanisms underlying this initial processing of camouflaged motion in the primate visual brain? We investigated this question using intrinsic-signal optical imaging of macaque V1, V2 and V4, along with computer simulations of the neural population responses. We found that camouflaged motion at low speed was processed as a direction signal by both direction- and orientation-selective neurons, whereas at high-speed camouflaged motion was encoded as a motion-streak signal primarily by orientation-selective neurons. No population responses were found to be invariant to the camouflage contours. These results suggest that the initial processing of camouflaged motion at low and high speeds is encoded as direction and motion-streak signals in primate early visual cortices. These processes are consistent with a spatio-temporal filter mechanism that provides for fast processing of motion signals, prior to full recognition of camouflage-breaking animals.
Collapse
Affiliation(s)
- Jiapeng Yin
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Hongliang Gong
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Xu An
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Zheyuan Chen
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Yiliang Lu
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Ian M Andolina
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| | - Niall McLoughlin
- Faculty of Life Science, University of Manchester, Manchester M13 9PT, UK
| | - Wei Wang
- Institute of Neuroscience, State Key Laboratory of Neuroscience and Key Laboratory of Primate Neurobiology, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, People's Republic of China
| |
Collapse
|
13
|
Abstract
Theories of object recognition agree that shape is of primordial importance, but there is no consensus about how shape might be represented, and so far attempts to implement a model of shape perception that would work with realistic stimuli have largely failed. Recent studies suggest that state-of-the-art convolutional ‘deep’ neural networks (DNNs) capture important aspects of human object perception. We hypothesized that these successes might be partially related to a human-like representation of object shape. Here we demonstrate that sensitivity for shape features, characteristic to human and primate vision, emerges in DNNs when trained for generic object recognition from natural photographs. We show that these models explain human shape judgments for several benchmark behavioral and neural stimulus sets on which earlier models mostly failed. In particular, although never explicitly trained for such stimuli, DNNs develop acute sensitivity to minute variations in shape and to non-accidental properties that have long been implicated to form the basis for object recognition. Even more strikingly, when tested with a challenging stimulus set in which shape and category membership are dissociated, the most complex model architectures capture human shape sensitivity as well as some aspects of the category structure that emerges from human judgments. As a whole, these results indicate that convolutional neural networks not only learn physically correct representations of object categories but also develop perceptually accurate representational spaces of shapes. An even more complete model of human object representations might be in sight by training deep architectures for multiple tasks, which is so characteristic in human development. Shape plays an important role in object recognition. Despite years of research, no models of vision could account for shape understanding as found in human vision of natural images. Given recent successes of deep neural networks (DNNs) in object recognition, we hypothesized that DNNs might in fact learn to capture perceptually salient shape dimensions. Using a variety of stimulus sets, we demonstrate here that the output layers of several DNNs develop representations that relate closely to human perceptual shape judgments. Surprisingly, such sensitivity to shape develops in these models even though they were never explicitly trained for shape processing. Moreover, we show that these models also represent categorical object similarity that follows human semantic judgments, albeit to a lesser extent. Taken together, our results bring forward the exciting idea that DNNs capture not only objective dimensions of stimuli, such as their category, but also their subjective, or perceptual, aspects, such as shape and semantic similarity as judged by humans.
Collapse
Affiliation(s)
- Jonas Kubilius
- Brain and Cognition, University of Leuven (KU Leuven), Leuven, Belgium
- * E-mail: (JK); (HPOdB)
| | - Stefania Bracci
- Brain and Cognition, University of Leuven (KU Leuven), Leuven, Belgium
| | - Hans P. Op de Beeck
- Brain and Cognition, University of Leuven (KU Leuven), Leuven, Belgium
- * E-mail: (JK); (HPOdB)
| |
Collapse
|
14
|
Skerswetat J, Formankiewicz MA, Waugh SJ. Very few exclusive percepts for contrast-modulated stimuli during binocular rivalry. Vision Res 2016; 121:10-22. [DOI: 10.1016/j.visres.2016.01.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2015] [Revised: 01/20/2016] [Accepted: 01/20/2016] [Indexed: 11/23/2022]
|