1
|
Lindeberg T. Orientation selectivity properties for the affine Gaussian derivative and the affine Gabor models for visual receptive fields. J Comput Neurosci 2025; 53:61-98. [PMID: 39878929 PMCID: PMC11868404 DOI: 10.1007/s10827-024-00888-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Revised: 11/08/2024] [Accepted: 12/11/2024] [Indexed: 01/31/2025]
Abstract
This paper presents an in-depth theoretical analysis of the orientation selectivity properties of simple cells and complex cells, that can be well modelled by the generalized Gaussian derivative model for visual receptive fields, with the purely spatial component of the receptive fields determined by oriented affine Gaussian derivatives for different orders of spatial differentiation. A detailed mathematical analysis is presented for the three different cases of either: (i) purely spatial receptive fields, (ii) space-time separable spatio-temporal receptive fields and (iii) velocity-adapted spatio-temporal receptive fields. Closed-form theoretical expressions for the orientation selectivity curves for idealized models of simple and complex cells are derived for all these main cases, and it is shown that the orientation selectivity of the receptive fields becomes more narrow, as a scale parameter ratio κ , defined as the ratio between the scale parameters in the directions perpendicular to vs. parallel with the preferred orientation of the receptive field, increases. It is also shown that the orientation selectivity becomes more narrow with increasing order of spatial differentiation in the underlying affine Gaussian derivative operators over the spatial domain. A corresponding theoretical orientation selectivity analysis is also presented for purely spatial receptive fields according to an affine Gabor model, showing that: (i) the orientation selectivity becomes more narrow when making the receptive fields wider in the direction perpendicular to the preferred orientation of the receptive field; while (ii) an additional degree of freedom in the affine Gabor model does, however, also strongly affect the orientation selectivity properties.
Collapse
Affiliation(s)
- Tony Lindeberg
- Computational Brain Science Lab, Division of Computational Science and Technology, KTH Royal Institute of Technology, SE-100 44, Stockholm, Sweden.
| |
Collapse
|
2
|
Jung YJ, Meffin H, Ibbotson MR. Characterization of receptive fields in the dorsal lateral geniculate nucleus of the tammar wallaby. J Neurophysiol 2025; 133:815-824. [PMID: 39887254 DOI: 10.1152/jn.00352.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Revised: 09/10/2024] [Accepted: 01/24/2025] [Indexed: 02/01/2025] Open
Abstract
Orientation selectivity is a prominent feature of neurons in the mammalian primary visual cortex (V1), yet its emergence along the visual pathway varies across species. In carnivores and primates, neurons with elongated and orientation-selective receptive fields (RFs) emerge in V1, whereas in mice such RFs appear earlier, in the retina or dorsal lateral geniculate nucleus (dLGN). Here, we investigate the RF properties of neurons in the dLGN of a marsupial, the wallaby (Macropus eugenii) (n = 2; males), using multichannel electrodes and nonlinear input model (NIM) analysis. Do dLGN RFs resemble those of carnivores and primates or exhibit unique characteristics, particularly regarding orientation selectivity? We found that 82% of neurons have a predominant ON-center response. We identified two main cell types: X-cells (n = 15/22), which exhibit linear properties, and Y-cells (n = 7/22), which display nonlinear characteristics. Most dLGN RFs were blob-like and lacked the oriented structures seen in cortical neurons but some had slightly elongated central areas. These results indicate that robust orientation selectivity develops fully in V1 (76% of neurons). However, mild orientation biases were observed in 41% of dLGN neurons. This study enhances our understanding of visual processing in marsupials and underscores the evolutionary significance of orientation selectivity in mammalian visual pathways.NEW & NOTEWORTHY This study examines receptive field (RF) properties of neurons in the dorsal lateral geniculate nucleus (dLGN) of wallabies using multichannel electrodes and nonlinear input model (NIM) analysis. We identified two main cell types: X-cells (linear) and Y-cells (nonlinear). Most dLGN RFs were blob-like, with mild orientation biases in 41% of neurons, indicating robust orientation selectivity develops fully in primary visual cortex (V1) (76% of neurons).
Collapse
Affiliation(s)
- Young Jun Jung
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
| | - Hamish Meffin
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
| | - Michael R Ibbotson
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
| |
Collapse
|
3
|
Jung YJ, Almasi A, Sun S, Yunzab M, Baquier SH, Renfree M, Meffin H, Ibbotson MR. Feature selectivity and invariance in marsupial primary visual cortex. J Physiol 2025; 603:423-445. [PMID: 39625561 PMCID: PMC11737535 DOI: 10.1113/jp285757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 11/15/2024] [Indexed: 01/18/2025] Open
Abstract
A fundamental question in sensory neuroscience revolves around how neurons represent complex visual stimuli. In mammalian primary visual cortex (V1), neurons decode intricate visual features to identify objects, with most being selective for edge orientation, but with half of those also developing invariance to edge position within their receptive fields. Position invariance allows cells to continue to code an edge even when it moves around. Combining feature selectivity and invariance is integral to successful object recognition. Considering the marsupial-eutherian divergence 160 million years ago, we explored whether feature selectivity and invariance was similar in marsupials and eutherians. We recovered the spatial filters and non-linear processing characteristics of the receptive fields of neurons in wallaby V1 and compared them with previous results from cat cortex. We stimulated the neurons in V1 with white Gaussian noise and analysed responses using the non-linear input model. Wallabies exhibit the same high percentage of orientation selective neurons as cats. However, in wallabies we observed a notably higher prevalence of neurons with three or more filters compared to cats. We show that having three or more filters substantially increases phase invariance in the V1s of both species, but that wallaby V1 accentuates this feature, suggesting that the species condenses more processing into the earliest cortical stage. These findings suggest that evolution has led to more than one solution to the problem of creating complex visual processing strategies. KEY POINTS: Previous studies have shown that the primary visual cortex (V1) in mammals is essential for processing complex visual stimuli, with neurons displaying selectivity for edge orientation and position. This research explores whether the visual processing mechanisms in marsupials, such as wallabies, are similar to those in eutherian mammals (e.g. cats). The study found that wallabies have a higher prevalence of neurons with multiple spatial filters in V1, indicating more complex visual processing. Using a non-linear input model, we demonstrated that neurons with three or more filters increase phase invariance. These findings suggest that marsupials and eutherian mammals have evolved similar strategies for visual processing, but marsupials have condensed more capacity to build phase invariance into the first step in the cortical pathway.
Collapse
Affiliation(s)
- Young Jun Jung
- Department of Biomedical EngineeringThe University of MelbourneMelbourneVictoriaAustralia
- National Vision Research Institute, MelbourneAustralian College of OptometryVictoriaAustralia
- Department of Optometry and Vision SciencesThe University of MelbourneMelbourneVictoriaAustralia
| | - Ali Almasi
- National Vision Research Institute, MelbourneAustralian College of OptometryVictoriaAustralia
| | - Shi Sun
- National Vision Research Institute, MelbourneAustralian College of OptometryVictoriaAustralia
| | - Molis Yunzab
- National Vision Research Institute, MelbourneAustralian College of OptometryVictoriaAustralia
| | - Sebastien H. Baquier
- Melbourne Veterinary School, Faculty of ScienceThe University of MelbourneMelbourneVictoriaAustralia
| | - Marilyn Renfree
- School of BioSciencesThe University of MelbourneMelbourneVictoriaAustralia
| | - Hamish Meffin
- Department of Biomedical EngineeringThe University of MelbourneMelbourneVictoriaAustralia
| | - Michael R. Ibbotson
- Department of Biomedical EngineeringThe University of MelbourneMelbourneVictoriaAustralia
- National Vision Research Institute, MelbourneAustralian College of OptometryVictoriaAustralia
- Department of Optometry and Vision SciencesThe University of MelbourneMelbourneVictoriaAustralia
| |
Collapse
|
4
|
Liu ML, Liu YP, Guo XX, Wu ZY, Zhang XT, Roe AW, Hu JM. Orientation selectivity mapping in the visual cortex. Prog Neurobiol 2024; 240:102656. [PMID: 39009108 DOI: 10.1016/j.pneurobio.2024.102656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 06/17/2024] [Accepted: 07/05/2024] [Indexed: 07/17/2024]
Abstract
The orientation map is one of the most well-studied functional maps of the visual cortex. However, results from the literature are of different qualities. Clear boundaries among different orientation domains and blurred uncertain distinctions were shown in different studies. These unclear imaging results will lead to an inaccuracy in depicting cortical structures, and the lack of consideration in experimental design will also lead to biased depictions of the cortical features. How we accurately define orientation domains will impact the entire field of research. In this study, we test how spatial frequency (SF), stimulus size, location, chromatic, and data processing methods affect the orientation functional maps (including a large area of dorsal V4, and parts of dorsal V1) acquired by intrinsic signal optical imaging. Our results indicate that, for large imaging fields, large grating stimuli with mixed SF components should be considered to acquire the orientation map. A diffusion model image enhancement based on the difference map could further improve the map quality. In addition, the similar outcomes of achromatic and chromatic gratings indicate two alternative types of afferents from LGN, pooling in V1 to generate cue-invariant orientation selectivity.
Collapse
Affiliation(s)
- Mei-Lan Liu
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China
| | - Yi-Peng Liu
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Xin-Xia Guo
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Zhi-Yi Wu
- Eye Center, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310010, China
| | - Xiao-Tong Zhang
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, Hangzhou 310012, China; College of Electrical Engineering, Zhejiang University, Hangzhou 310000, China
| | - Anna Wang Roe
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, Hangzhou 310012, China; The State Key Laboratory of Brain-Machine Intelligence, Zhejiang University, Hangzhou 310058, China.
| | - Jia-Ming Hu
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, Hangzhou 310012, China.
| |
Collapse
|
5
|
Shimaoka D, Wong YT, Rosa MGP, Price NSC. Naturalistic movies and encoding analysis define areal borders in marmoset third-tier visual cortex. Prog Neurobiol 2024; 240:102657. [PMID: 39103115 DOI: 10.1016/j.pneurobio.2024.102657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 06/24/2024] [Accepted: 07/30/2024] [Indexed: 08/07/2024]
Abstract
Accurate definition of the borders of cortical visual areas is essential for the study of neuronal processes leading to perception. However, data used for definition of areal boundaries have suffered from issues related to resolution, uniform coverage, or suitability for objective analysis, leading to ambiguity. Here, we present a novel approach that combines widefield optical imaging, presentation of naturalistic movies, and encoding model analysis, to objectively define borders in the primate extrastriate cortex. We applied this method to test conflicting hypotheses about the third-tier visual cortex, where areal boundaries have remained controversial. We demonstrate pronounced tuning preferences in the third-tier areas, and an organizational structure in which the dorsomedial area (DM) contains representations of both the upper and lower contralateral quadrants, and is located immediate anterior to V2. High-density electrophysiological recordings with a Neuropixels probe confirm these findings. Our encoding-model approach offers a powerful, objective way to disambiguate areal boundaries.
Collapse
Affiliation(s)
- Daisuke Shimaoka
- Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, Australia.
| | - Yan Tat Wong
- Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, Australia; Electrical and Computer Systems Engineering, Monash University, Clayton, Australia
| | - Marcello G P Rosa
- Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, Australia
| | - Nicholas Seow Chiang Price
- Department of Physiology and Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, Australia
| |
Collapse
|
6
|
Wu J, Chen Y, Veeraraghavan A, Seidemann E, Robinson JT. Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope. Nat Commun 2024; 15:1271. [PMID: 38341403 PMCID: PMC10858944 DOI: 10.1038/s41467-024-45417-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 01/22/2024] [Indexed: 02/12/2024] Open
Abstract
Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body of literature suggests that neural activity can be different when animals are free to move compared to when they are restrained. Unfortunately, existing systems for imaging calcium dynamics over large areas in non-human primates (NHPs) are table-top devices that require restraint of the animal's head. Here, we demonstrate an imaging device capable of imaging mesoscale calcium activity in a head-unrestrained male non-human primate. We successfully miniaturize our system by replacing lenses with an optical mask and computational algorithms. The resulting lensless microscope can fit comfortably on an NHP, allowing its head to move freely while imaging. We are able to measure orientation columns maps over a 20 mm2 field-of-view in a head-unrestrained macaque. Our work establishes mesoscopic imaging using a lensless microscope as a powerful approach for studying neural activity under more naturalistic conditions.
Collapse
Affiliation(s)
- Jimin Wu
- Department of Bioengineering, Rice University, 6100 Main Street, Houston, TX, 77005, USA
| | - Yuzhi Chen
- Department of Neuroscience, University of Texas at Austin, 100 E 24th St., Austin, TX, 78712, USA
- Department of Psychology, University of Texas at Austin, 108 E Dean Keeton St., Austin, TX, 78712, USA
| | - Ashok Veeraraghavan
- Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, TX, 77005, USA
- Department of Computer Science, Rice University, 6100 Main Street, Houston, TX, 77005, USA
| | - Eyal Seidemann
- Department of Neuroscience, University of Texas at Austin, 100 E 24th St., Austin, TX, 78712, USA.
- Department of Psychology, University of Texas at Austin, 108 E Dean Keeton St., Austin, TX, 78712, USA.
| | - Jacob T Robinson
- Department of Bioengineering, Rice University, 6100 Main Street, Houston, TX, 77005, USA.
- Department of Electrical and Computer Engineering, Rice University, 6100 Main Street, Houston, TX, 77005, USA.
- Department of Neuroscience, Baylor College of Medicine, One Baylor Plaza, Houston, TX, 77030, USA.
| |
Collapse
|
7
|
Jung YJ, Sun SH, Almasi A, Yunzab M, Meffin H, Ibbotson MR. Characterization of extracellular spike waveforms recorded in wallaby primary visual cortex. Front Neurosci 2023; 17:1244952. [PMID: 37746137 PMCID: PMC10517629 DOI: 10.3389/fnins.2023.1244952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 08/25/2023] [Indexed: 09/26/2023] Open
Abstract
Extracellular recordings were made from 642 units in the primary visual cortex (V1) of a highly visual marsupial, the Tammar wallaby. The receptive field (RF) characteristics of the cells were objectively estimated using the non-linear input model (NIM), and these were correlated with spike shapes. We found that wallaby cortical units had 68% regular spiking (RS), 12% fast spiking (FS), 4% triphasic spiking (TS), 5% compound spiking (CS) and 11% positive spiking (PS). RS waveforms are most often associated with recordings from pyramidal or spiny stellate cell bodies, suggesting that recordings from these cell types dominate in the wallaby cortex. In wallaby, 70-80% of FS and RS cells had orientation selective RFs and had evenly distributed linear and nonlinear RFs. We found that 47% of wallaby PS units were non-orientation selective and they were dominated by linear RFs. Previous studies suggest that the PS units represent recordings from the axon terminals of non-orientation selective cells originating in the lateral geniculate nucleus (LGN). If this is also true in wallaby, as strongly suggested by their low response latencies and bursty spiking properties, the results suggest that significantly more neurons in wallaby LGN are already orientation selective. In wallaby, less than 10% of recorded spikes had triphasic (TS) or sluggish compound spiking (CS) waveforms. These units had a mixture of orientation selective and non-oriented properties, and their cellular origins remain difficult to classify.
Collapse
Affiliation(s)
- Young Jun Jung
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia
- National Vision Research Institute, Australian College of Optometry Carlton, Carlton, VIC, Australia
- Department of Optometry and Vision Sciences, The University of Melbourne, Melbourne, VIC, Australia
| | - Shi H. Sun
- National Vision Research Institute, Australian College of Optometry Carlton, Carlton, VIC, Australia
| | - Ali Almasi
- National Vision Research Institute, Australian College of Optometry Carlton, Carlton, VIC, Australia
| | - Molis Yunzab
- National Vision Research Institute, Australian College of Optometry Carlton, Carlton, VIC, Australia
| | - Hamish Meffin
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia
| | - Michael R. Ibbotson
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia
- National Vision Research Institute, Australian College of Optometry Carlton, Carlton, VIC, Australia
- Department of Optometry and Vision Sciences, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|