1
|
Vinck M, Uran C, Dowdall JR, Rummell B, Canales-Johnson A. Large-scale interactions in predictive processing: oscillatory versus transient dynamics. Trends Cogn Sci 2025; 29:133-148. [PMID: 39424521 PMCID: PMC7616854 DOI: 10.1016/j.tics.2024.09.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 09/17/2024] [Accepted: 09/26/2024] [Indexed: 10/21/2024]
Abstract
How do the two main types of neural dynamics, aperiodic transients and oscillations, contribute to the interactions between feedforward (FF) and feedback (FB) pathways in sensory inference and predictive processing? We discuss three theoretical perspectives. First, we critically evaluate the theory that gamma and alpha/beta rhythms play a role in classic hierarchical predictive coding (HPC) by mediating FF and FB communication, respectively. Second, we outline an alternative functional model in which rapid sensory inference is mediated by aperiodic transients, whereas oscillations contribute to the stabilization of neural representations over time and plasticity processes. Third, we propose that the strong dependence of oscillations on predictability can be explained based on a biologically plausible alternative to classic HPC, namely dendritic HPC.
Collapse
Affiliation(s)
- Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University, 6525 Nijmegen, The Netherlands.
| | - Cem Uran
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University, 6525 Nijmegen, The Netherlands.
| | - Jarrod R Dowdall
- Robarts Research Institute, Western University, London, ON, Canada
| | - Brian Rummell
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany
| | - Andres Canales-Johnson
- Facultad de Ciencias de la Salud, Universidad Catolica del Maule, 3480122 Talca, Chile; Department of Psychology, University of Cambridge, Cambridge CB2 3EB, UK.
| |
Collapse
|
2
|
Kanth ST, Ray S. Gamma Responses to Colored Natural Stimuli Can Be Predicted from Local Low-Level Stimulus Features. eNeuro 2024; 11:ENEURO.0417-23.2024. [PMID: 39054054 PMCID: PMC11277289 DOI: 10.1523/eneuro.0417-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 05/17/2024] [Accepted: 07/01/2024] [Indexed: 07/27/2024] Open
Abstract
The role of gamma rhythm (30-80 Hz) in visual processing is debated; stimuli like gratings and hue patches generate strong gamma, but many natural images do not. Could image gamma responses be predicted by approximating images as gratings or hue patches? Surprisingly, this question remains unanswered, since the joint dependence of gamma on multiple features is poorly understood. We recorded local field potentials and electrocorticogram from two female monkeys while presenting natural images and parametric stimuli varying along several feature dimensions. Gamma responses to different grating/hue features were separable, allowing for a multiplicative model based on individual features. By fitting a hue patch to the image around the receptive field, this simple model could predict gamma responses to chromatic images across scales with reasonably high accuracy. Our results provide a simple "baseline" model to predict gamma from local image properties, against which more complex models of natural vision can be tested.
Collapse
Affiliation(s)
- Sidrat Tasawoor Kanth
- IISc Mathematics Initiative, Indian Institute of Science, Bangalore 560012, India
- Center for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| | - Supratim Ray
- IISc Mathematics Initiative, Indian Institute of Science, Bangalore 560012, India
- Center for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| |
Collapse
|
3
|
Luo L, Wang X, Lu J, Chen G, Luan G, Li W, Wang Q, Fang F. Local field potentials, spiking activity, and receptive fields in human visual cortex. SCIENCE CHINA. LIFE SCIENCES 2024; 67:543-554. [PMID: 37957484 DOI: 10.1007/s11427-023-2436-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 08/21/2023] [Indexed: 11/15/2023]
Abstract
The concept of receptive field (RF) is central to sensory neuroscience. Neuronal RF properties have been substantially studied in animals, while those in humans remain nearly unexplored. Here, we measured neuronal RFs with intracranial local field potentials (LFPs) and spiking activity in human visual cortex (V1/V2/V3). We recorded LFPs via macro-contacts and discovered that RF sizes estimated from low-frequency activity (LFA, 0.5-30 Hz) were larger than those estimated from low-gamma activity (LGA, 30-60 Hz) and high-gamma activity (HGA, 60-150 Hz). We then took a rare opportunity to record LFPs and spiking activity via microwires in V1 simultaneously. We found that RF sizes and temporal profiles measured from LGA and HGA closely matched those from spiking activity. In sum, this study reveals that spiking activity of neurons in human visual cortex could be well approximated by LGA and HGA in RF estimation and temporal profile measurement, implying the pivotal functions of LGA and HGA in early visual information processing.
Collapse
Affiliation(s)
- Lu Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- School of Psychology, Beijing Sport University, Beijing, 100084, China
| | - Xiongfei Wang
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Junshi Lu
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
| | - Guanpeng Chen
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, 100871, China
| | - Guoming Luan
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Institute for Brain Disorders, Beijing, 100069, China
| | - Wu Li
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Qian Wang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
| | - Fang Fang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, 100871, China.
| |
Collapse
|
4
|
Olman CA. What multiplexing means for the interpretation of functional MRI data. Front Hum Neurosci 2023; 17:1134811. [PMID: 37091812 PMCID: PMC10117671 DOI: 10.3389/fnhum.2023.1134811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 03/20/2023] [Indexed: 04/08/2023] Open
Abstract
Despite technology advances that have enabled routine acquisition of functional MRI data with sub-millimeter resolution, the inferences that cognitive neuroscientists must make to link fMRI data to behavior are complicated. Thus, a single dataset subjected to different analyses can be interpreted in different ways. This article presents two optical analogies that can be useful for framing fMRI analyses in a way that allows for multiple interpretations of fMRI data to be valid simultaneously without undermining each other. The first is reflection: when an object is reflected in a mirrored surface, it appears as if the reflected object is sharing space with the mirrored object, but of course it is not. This analogy can be a good guide for interpreting the fMRI signal, since even at sub-millimeter resolutions the signal is determined by a mixture of local and long-range neural computations. The second is refraction. If we view an object through a multi-faceted prism or gemstone, our view will change-sometimes dramatically-depending on our viewing angle. In the same way, interpretation of fMRI data (inference of underlying neuronal activity) can and should be different depending on the analysis approach. Rather than representing a weakness of the methodology, or the superiority of one approach over the other (for example, simple regression analysis versus multi-voxel pattern analysis), this is an expected consequence of how information is multiplexed in the neural networks of the brain: multiple streams of information are simultaneously present in each location. The fact that any one analysis typically shows only one view of the data also puts some parentheses around fMRI practitioners' constant search for ground truth against which to compare their data. By holding our interpretations lightly and understanding that many interpretations of the data can all be true at the same time, we do a better job of preparing ourselves to appreciate, and eventually understand, the complexity of the brain and the behavior it produces.
Collapse
Affiliation(s)
- Cheryl A. Olman
- Department of Psychology, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
5
|
Himmelberg MM, Gardner JL, Winawer J. What has vision science taught us about functional MRI? Neuroimage 2022; 261:119536. [PMID: 35931310 PMCID: PMC9756767 DOI: 10.1016/j.neuroimage.2022.119536] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 07/21/2022] [Accepted: 08/02/2022] [Indexed: 10/31/2022] Open
Abstract
In the domain of human neuroimaging, much attention has been paid to the question of whether and how the development of functional magnetic resonance imaging (fMRI) has advanced our scientific knowledge of the human brain. However, the opposite question is also important; how has our knowledge of the brain advanced our understanding of fMRI? Here, we discuss how and why scientific knowledge about the human and animal visual system has been used to answer fundamental questions about fMRI as a brain measurement tool and how these answers have contributed to scientific discoveries beyond vision science.
Collapse
Affiliation(s)
- Marc M Himmelberg
- Department of Psychology, New York University, NY, USA; Center for Neural Science, New York University, NY, USA.
| | | | - Jonathan Winawer
- Department of Psychology, New York University, NY, USA; Center for Neural Science, New York University, NY, USA
| |
Collapse
|
6
|
Natural scene sampling reveals reliable coarse-scale orientation tuning in human V1. Nat Commun 2022; 13:6469. [PMID: 36309512 PMCID: PMC9617970 DOI: 10.1038/s41467-022-34134-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 10/13/2022] [Indexed: 12/25/2022] Open
Abstract
Orientation selectivity in primate visual cortex is organized into cortical columns. Since cortical columns are at a finer spatial scale than the sampling resolution of standard BOLD fMRI measurements, analysis approaches have been proposed to peer past these spatial resolution limitations. It was recently found that these methods are predominantly sensitive to stimulus vignetting - a form of selectivity arising from an interaction of the oriented stimulus with the aperture edge. Beyond vignetting, it is not clear whether orientation-selective neural responses are detectable in BOLD measurements. Here, we leverage a dataset of visual cortical responses measured using high-field 7T fMRI. Fitting these responses using image-computable models, we compensate for vignetting and nonetheless find reliable tuning for orientation. Results further reveal a coarse-scale map of orientation preference that may constitute the neural basis for known perceptual anisotropies. These findings settle a long-standing debate in human neuroscience, and provide insights into functional organization principles of visual cortex.
Collapse
|
7
|
Aligning evidence for the genesis of visual gamma oscillations. PLoS Biol 2022; 20:e3001701. [PMID: 35763497 PMCID: PMC9239443 DOI: 10.1371/journal.pbio.3001701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
|
8
|
Shirhatti V, Ravishankar P, Ray S. Gamma oscillations in primate primary visual cortex are severely attenuated by small stimulus discontinuities. PLoS Biol 2022; 20:e3001666. [PMID: 35700175 PMCID: PMC9197048 DOI: 10.1371/journal.pbio.3001666] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 05/10/2022] [Indexed: 11/22/2022] Open
Abstract
Gamma oscillations (30 to 80 Hz) have been hypothesized to play an important role in feature binding, based on the observation that continuous long bars induce stronger gamma in the visual cortex than bars with a small gap. Recently, many studies have shown that natural images, which have discontinuities in several low-level features, do not induce strong gamma oscillations, questioning their role in feature binding. However, the effect of different discontinuities on gamma has not been well studied. To address this, we recorded spikes and local field potential from 2 monkeys while they were shown gratings with discontinuities in 4 attributes: space, orientation, phase, or contrast. We found that while these discontinuities only had a modest effect on spiking activity, gamma power drastically reduced in all cases, suggesting that gamma could be a resonant phenomenon. An excitatory–inhibitory population model with stimulus-tuned recurrent inputs showed such resonant properties. Therefore, gamma could be a signature of excitation–inhibition balance, which gets disrupted due to discontinuities. Gamma oscillations (30-80 Hz) in visual cortex have been hypothesized to play an important role in feature binding, but this role has recently been questioned. This study shows that visual stimulus-induced gamma oscillations are highly attenuated with even small discontinuities in the stimulus. This "resonant" behaviour can be explained by a simple excitatory-inhibitory model in which discontinuities lead to a small reduction in lateral inputs.
Collapse
Affiliation(s)
- Vinay Shirhatti
- Centre for Neuroscience, Indian Institute of Science, Bengaluru, India
- IISc Mathematics Initiative, Indian Institute of Science, Bengaluru, India
| | | | - Supratim Ray
- Centre for Neuroscience, Indian Institute of Science, Bengaluru, India
- IISc Mathematics Initiative, Indian Institute of Science, Bengaluru, India
- * E-mail:
| |
Collapse
|
9
|
Stauch BJ, Peter A, Ehrlich I, Nolte Z, Fries P. Human visual gamma for color stimuli. eLife 2022; 11:e75897. [PMID: 35532123 PMCID: PMC9122493 DOI: 10.7554/elife.75897] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
Strong gamma-band oscillations in primate early visual cortex can be induced by homogeneous color surfaces (Peter et al., 2019; Shirhatti and Ray, 2018). Compared to other hues, particularly strong gamma oscillations have been reported for red stimuli. However, precortical color processing and the resultant strength of input to V1 have often not been fully controlled for. Therefore, stronger responses to red might be due to differences in V1 input strength. We presented stimuli that had equal luminance and cone contrast levels in a color coordinate system based on responses of the lateral geniculate nucleus, the main input source for area V1. With these stimuli, we recorded magnetoencephalography in 30 human participants. We found gamma oscillations in early visual cortex which, contrary to previous reports, did not differ between red and green stimuli of equal L-M cone contrast. Notably, blue stimuli with contrast exclusively on the S-cone axis induced very weak gamma responses, as well as smaller event-related fields and poorer change-detection performance. The strength of human color gamma responses for stimuli on the L-M axis could be well explained by L-M cone contrast and did not show a clear red bias when L-M cone contrast was properly equalized.
Collapse
Affiliation(s)
- Benjamin J Stauch
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Brain Imaging Center, Goethe University FrankfurtFrankfurtGermany
| | - Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
| | - Isabelle Ehrlich
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- Department of Psychology, Goethe University FrankfurtFrankfurtGermany
| | - Zora Nolte
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Donders Institute for Brain, Cognition and Behaviour, Radboud University NijmegenNijmegenNetherlands
| |
Collapse
|
10
|
Uran C, Peter A, Lazar A, Barnes W, Klon-Lipok J, Shapcott KA, Roese R, Fries P, Singer W, Vinck M. Predictive coding of natural images by V1 firing rates and rhythmic synchronization. Neuron 2022; 110:1240-1257.e8. [PMID: 35120628 PMCID: PMC8992798 DOI: 10.1016/j.neuron.2022.01.002] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 11/22/2021] [Accepted: 01/04/2022] [Indexed: 01/12/2023]
Abstract
Predictive coding is an important candidate theory of self-supervised learning in the brain. Its central idea is that sensory responses result from comparisons between bottom-up inputs and contextual predictions, a process in which rates and synchronization may play distinct roles. We recorded from awake macaque V1 and developed a technique to quantify stimulus predictability for natural images based on self-supervised, generative neural networks. We find that neuronal firing rates were mainly modulated by the contextual predictability of higher-order image features, which correlated strongly with human perceptual similarity judgments. By contrast, V1 gamma (γ)-synchronization increased monotonically with the contextual predictability of low-level image features and emerged exclusively for larger stimuli. Consequently, γ-synchronization was induced by natural images that are highly compressible and low-dimensional. Natural stimuli with low predictability induced prominent, late-onset beta (β)-synchronization, likely reflecting cortical feedback. Our findings reveal distinct roles of synchronization and firing rates in the predictive coding of natural images.
Collapse
Affiliation(s)
- Cem Uran
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 AJ Nijmegen, the Netherlands.
| | - Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Andreea Lazar
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - William Barnes
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Max Planck Institute for Brain Research, 60438 Frankfurt, Germany
| | - Johanna Klon-Lipok
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Max Planck Institute for Brain Research, 60438 Frankfurt, Germany
| | - Katharine A Shapcott
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Frankfurt Institute for Advanced Studies, 60438 Frankfurt, Germany
| | - Rasmus Roese
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Institute for Brain, Cognition and Behaviour, Department of Biophysics, Radboud University Nijmegen, 6525 AJ Nijmegen, the Netherlands
| | - Wolf Singer
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Max Planck Institute for Brain Research, 60438 Frankfurt, Germany; Frankfurt Institute for Advanced Studies, 60438 Frankfurt, Germany
| | - Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 AJ Nijmegen, the Netherlands.
| |
Collapse
|
11
|
Broderick WF, Simoncelli EP, Winawer J. Mapping spatial frequency preferences across human primary visual cortex. J Vis 2022; 22:3. [PMID: 35266962 PMCID: PMC8934567 DOI: 10.1167/jov.22.4.3] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/23/2022] [Indexed: 01/13/2023] Open
Abstract
Neurons in primate visual cortex (area V1) are tuned for spatial frequency, in a manner that depends on their position in the visual field. Several studies have examined this dependency using functional magnetic resonance imaging (fMRI), reporting preferred spatial frequencies (tuning curve peaks) of V1 voxels as a function of eccentricity, but their results differ by as much as two octaves, presumably owing to differences in stimuli, measurements, and analysis methodology. Here, we characterize spatial frequency tuning at a millimeter resolution within the human primary visual cortex, across stimulus orientation and visual field locations. We measured fMRI responses to a novel set of stimuli, constructed as sinusoidal gratings in log-polar coordinates, which include circular, radial, and spiral geometries. For each individual stimulus, the local spatial frequency varies inversely with eccentricity, and for any given location in the visual field, the full set of stimuli span a broad range of spatial frequencies and orientations. Over the measured range of eccentricities, the preferred spatial frequency is well-fit by a function that varies as the inverse of the eccentricity plus a small constant. We also find small but systematic effects of local stimulus orientation, defined in both absolute coordinates and relative to visual field location. Specifically, peak spatial frequency is higher for pinwheel than annular stimuli and for horizontal than vertical stimuli.
Collapse
Affiliation(s)
- William F Broderick
- Center for Neural Science, New York University, New York, NY, USA
- https://wfbroderick.com/
| | - Eero P Simoncelli
- Center for Neural Science, and Courant Institue for Mathematical Sciences, New York University, New York, NY, USA
- Flatiron Institute, Simons Foundation, USA
| | - Jonathan Winawer
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
12
|
Li Y, Bosking W, Beauchamp MS, Sheth SA, Yoshor D, Bartoli E, Foster BL. Biased Orientation and Color Tuning of the Human Visual Gamma Rhythm. J Neurosci 2022; 42:1054-1067. [PMID: 34965979 PMCID: PMC8824502 DOI: 10.1523/jneurosci.1085-21.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 11/19/2021] [Accepted: 12/15/2021] [Indexed: 11/21/2022] Open
Abstract
Narrowband γ oscillations (NBG: ∼20-60 Hz) in visual cortex reflect rhythmic fluctuations in population activity generated by underlying circuits tuned for stimulus location, orientation, and color. A variety of theories posit a specific role for NBG in encoding and communicating this information within visual cortex. However, recent findings suggest a more nuanced role for NBG, given its dependence on certain stimulus feature configurations, such as coherent-oriented edges and specific hues. Motivated by these factors, we sought to quantify the independent and joint tuning properties of NBG to oriented and color stimuli using intracranial recordings from the human visual cortex (male and female). NBG was shown to display a cardinal orientation bias (horizontal) and also an end- and mid-spectral color bias (red/blue and green). When jointly probed, the cardinal bias for orientation was attenuated and an end-spectral preference for red and blue predominated. This loss of mid-spectral tuning occurred even for recording sites showing large responses to uniform green stimuli. Our results demonstrate the close, yet complex, link between the population dynamics driving NBG oscillations and known feature selectivity biases for orientation and color within visual cortex. Such a bias in stimulus tuning imposes new constraints on the functional significance of the visual γ rhythm. More generally, these biases in population electrophysiology will need to be considered in experiments using orientation or color features to examine the role of visual cortex in other domains, such as working memory and decision-making.SIGNIFICANCE STATEMENT Oscillations in electrophysiological activity occur in visual cortex in response to stimuli that strongly drive the orientation or color selectivity of visual neurons. The significance of this induced "γ rhythm" to brain function remains unclear. Answering this question requires understanding how and why some stimuli can reliably generate oscillatory γ activity while others do not. We examined how different orientations and colors independently and jointly modulate γ oscillations in the human brain. Our data show that γ oscillations are greatest for certain orientations and colors that reflect known response biases in visual cortex. Such findings complicate the functional significance of γ oscillations but open new avenues for linking circuits to population dynamics in visual cortex.
Collapse
Affiliation(s)
- Ye Li
- Department of Neurosurgery
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas 77030
| | - William Bosking
- Department of Neurosurgery, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Michael S Beauchamp
- Department of Neurosurgery, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Sameer A Sheth
- Department of Neurosurgery
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas 77030
| | - Daniel Yoshor
- Department of Neurosurgery, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | | | - Brett L Foster
- Department of Neurosurgery, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania 19104
| |
Collapse
|
13
|
Kupers ER, Benson NC, Winawer J. A visual encoding model links magnetoencephalography signals to neural synchrony in human cortex. Neuroimage 2021; 245:118655. [PMID: 34687857 PMCID: PMC8788390 DOI: 10.1016/j.neuroimage.2021.118655] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 10/11/2021] [Indexed: 01/23/2023] Open
Abstract
Synchronization of neuronal responses over large distances is hypothesized to be important for many cortical functions. However, no straightforward methods exist to estimate synchrony non-invasively in the living human brain. MEG and EEG measure the whole brain, but the sensors pool over large, overlapping cortical regions, obscuring the underlying neural synchrony. Here, we developed a model from stimulus to cortex to MEG sensors to disentangle neural synchrony from spatial pooling of the instrument. We find that synchrony across cortex has a surprisingly large and systematic effect on predicted MEG spatial topography. We then conducted visual MEG experiments and separated responses into stimulus-locked and broadband components. The stimulus-locked topography was similar to model predictions assuming synchronous neural sources, whereas the broadband topography was similar to model predictions assuming asynchronous sources. We infer that visual stimulation elicits two distinct types of neural responses, one highly synchronous and one largely asynchronous across cortex.
Collapse
Affiliation(s)
- Eline R Kupers
- Department of Psychology, New York University, New York, NY 10003, United States; Center for Neural Science, New York University, New York, NY 10003, United States; Department of Psychology, Stanford University, Stanford, CA 94305, United States.
| | - Noah C Benson
- Department of Psychology, New York University, New York, NY 10003, United States; Center for Neural Science, New York University, New York, NY 10003, United States; eSciences Institute, University of Washington, Seattle, WA 98195, United States
| | - Jonathan Winawer
- Department of Psychology, New York University, New York, NY 10003, United States; Center for Neural Science, New York University, New York, NY 10003, United States
| |
Collapse
|
14
|
Broadband Dynamics Rather than Frequency-Specific Rhythms Underlie Prediction Error in the Primate Auditory Cortex. J Neurosci 2021; 41:9374-9391. [PMID: 34645605 DOI: 10.1523/jneurosci.0367-21.2021] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 09/15/2021] [Accepted: 09/20/2021] [Indexed: 11/21/2022] Open
Abstract
Detection of statistical irregularities, measured as a prediction error response, is fundamental to the perceptual monitoring of the environment. We studied whether prediction error response is associated with neural oscillations or asynchronous broadband activity. Electrocorticography was conducted in three male monkeys, who passively listened to the auditory roving oddball stimuli. Local field potentials (LFPs) recorded over the auditory cortex underwent spectral principal component analysis, which decoupled broadband and rhythmic components of the LFP signal. We found that the broadband component captured the prediction error response, whereas none of the rhythmic components were associated with statistical irregularities of sounds. The broadband component displayed more stochastic, asymmetrical multifractal properties than the rhythmic components, which revealed more self-similar dynamics. We thus conclude that the prediction error response is captured by neuronal populations generating asynchronous broadband activity, defined by irregular dynamic states, which, unlike oscillatory rhythms, appear to enable the neural representation of auditory prediction error response.SIGNIFICANCE STATEMENT This study aimed to examine the contribution of oscillatory and asynchronous components of auditory local field potentials in the generation of prediction error responses to sensory irregularities, as this has not been directly addressed in the previous studies. Here, we show that mismatch negativity-an auditory prediction error response-is driven by the asynchronous broadband component of potentials recorded in the auditory cortex. This finding highlights the importance of nonoscillatory neural processes in the predictive monitoring of the environment. At a more general level, the study demonstrates that stochastic neural processes, which are often disregarded as neural noise, do have a functional role in the processing of sensory information.
Collapse
|
15
|
Narrow and Broad γ Bands Process Complementary Visual Information in Mouse Primary Visual Cortex. eNeuro 2021; 8:ENEURO.0106-21.2021. [PMID: 34663617 PMCID: PMC8570688 DOI: 10.1523/eneuro.0106-21.2021] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 06/03/2021] [Accepted: 06/22/2021] [Indexed: 11/21/2022] Open
Abstract
γ Band plays a key role in the encoding of visual features in the primary visual cortex (V1). In rodents V1 two ranges within the γ band are sensitive to contrast: a broad γ band (BB) increasing with contrast, and a narrow γ band (NB), peaking at ∼60 Hz, decreasing with contrast. The functional roles of the two bands and the neural circuits originating them are not completely clear yet. Here, we show, combining experimental and simulated data, that in mice V1 (1) BB carries information about high contrast and NB about low contrast; (2) BB modulation depends on excitatory-inhibitory interplay in the cortex, while NB modulation is because of entrainment to the thalamic drive. In awake mice presented with alternating gratings, NB power progressively decreased from low to intermediate levels of contrast where it reached a plateau. Conversely, BB power was constant across low levels of contrast, but it progressively increased from intermediate to high levels of contrast. Furthermore, BB response was stronger immediately after contrast reversal, while the opposite held for NB. These complementary modulations were reproduced by a recurrent excitatory-inhibitory leaky integrate-and-fire network provided that the thalamic inputs were composed of a sustained and a periodic component having complementary sensitivity ranges. These results show that in rodents the thalamic-driven NB plays a specific key role in encoding visual contrast. Moreover, we propose a simple and effective network model of response to visual stimuli in rodents that might help in investigating network dysfunctions of pathologic visual information processing.
Collapse
|
16
|
Abstract
Selectivity for many basic properties of visual stimuli, such as orientation, is thought to be organized at the scale of cortical columns, making it difficult or impossible to measure directly with noninvasive human neuroscience measurement. However, computational analyses of neuroimaging data have shown that selectivity for orientation can be recovered by considering the pattern of response across a region of cortex. This suggests that computational analyses can reveal representation encoded at a finer spatial scale than is implied by the spatial resolution limits of measurement techniques. This potentially opens up the possibility to study a much wider range of neural phenomena that are otherwise inaccessible through noninvasive measurement. However, as we review in this article, a large body of evidence suggests an alternative hypothesis to this superresolution account: that orientation information is available at the spatial scale of cortical maps and thus easily measurable at the spatial resolution of standard techniques. In fact, a population model shows that this orientation information need not even come from single-unit selectivity for orientation tuning, but instead can result from population selectivity for spatial frequency. Thus, a categorical error of interpretation can result whereby orientation selectivity can be confused with spatial frequency selectivity. This is similarly problematic for the interpretation of results from numerous studies of more complex representations and cognitive functions that have built upon the computational techniques used to reveal stimulus orientation. We suggest in this review that these interpretational ambiguities can be avoided by treating computational analyses as models of the neural processes that give rise to measurement. Building upon the modeling tradition in vision science using considerations of whether population models meet a set of core criteria is important for creating the foundation for a cumulative and replicable approach to making valid inferences from human neuroscience measurements. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Justin L Gardner
- Department of Psychology, Stanford University, Stanford, California 94305, USA;
| | - Elisha P Merriam
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892, USA;
| |
Collapse
|
17
|
Das A, Ray S. Effect of Cross-Orientation Normalization on Different Neural Measures in Macaque Primary Visual Cortex. Cereb Cortex Commun 2021; 2:tgab009. [PMID: 34095837 PMCID: PMC8152940 DOI: 10.1093/texcom/tgab009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 01/26/2021] [Accepted: 01/27/2021] [Indexed: 11/14/2022] Open
Abstract
Divisive normalization is a canonical mechanism that can explain a variety of sensory phenomena. While normalization models have been used to explain spiking activity in response to different stimulus/behavioral conditions in multiple brain areas, it is unclear whether similar models can also explain modulation in population-level neural measures such as power at various frequencies in local field potentials (LFPs) or steady-state visually evoked potential (SSVEP) that is produced by flickering stimuli and popular in electroencephalogram studies. To address this, we manipulated normalization strength by presenting static as well as flickering orthogonal superimposed gratings (plaids) at varying contrasts to 2 female monkeys while recording multiunit activity (MUA) and LFP from the primary visual cortex and quantified the modulation in MUA, gamma (32-80 Hz), high-gamma (104-248 Hz) power, as well as SSVEP. Even under similar stimulus conditions, normalization strength was different for the 4 measures and increased as: spikes, high-gamma, SSVEP, and gamma. However, these results could be explained using a normalization model that was modified for population responses, by varying the tuned normalization parameter and semisaturation constant. Our results show that different neural measures can reflect the effect of stimulus normalization in different ways, which can be modeled by a simple normalization model.
Collapse
Affiliation(s)
- Aritra Das
- Centre for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| | - Supratim Ray
- Centre for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| |
Collapse
|
18
|
Oscillation-Based Connectivity Architecture Is Dominated by an Intrinsic Spatial Organization, Not Cognitive State or Frequency. J Neurosci 2020; 41:179-192. [PMID: 33203739 DOI: 10.1523/jneurosci.2155-20.2020] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2020] [Revised: 10/10/2020] [Accepted: 11/03/2020] [Indexed: 11/21/2022] Open
Abstract
Functional connectivity of neural oscillations (oscillation-based FC) is thought to afford dynamic information exchange across task-relevant neural ensembles. Although oscillation-based FC is classically defined relative to a prestimulus baseline, giving rise to rapid, context-dependent changes in individual connections, studies of distributed spatial patterns show that oscillation-based FC is omnipresent, occurring even in the absence of explicit cognitive demands. Thus, the issue of whether oscillation-based FC is primarily shaped by cognitive state or is intrinsic in nature remains open. Accordingly, we sought to reconcile these observations by interrogating the ECoG recordings of 18 presurgical human patients (8 females) for state dependence of oscillation-based FC in five canonical frequency bands across an array of six task states. FC analysis of phase and amplitude coupling revealed a highly similar, largely state-invariant (i.e., intrinsic) spatial component across cognitive states. This spatial organization was shared across all frequency bands. Crucially, however, each band also exhibited temporally independent FC dynamics capable of supporting frequency-specific information exchange. In conclusion, the spatial organization of oscillation-based FC is largely stable over cognitive states (i.e., primarily intrinsic in nature) and shared across frequency bands. Together, our findings converge with previous observations of spatially invariant patterns of FC derived from extremely slow and aperiodic fluctuations in fMRI signals. Our observations indicate that "background" FC should be accounted for in conceptual frameworks of oscillation-based FC targeting task-related changes.SIGNIFICANCE STATEMENT A fundamental property of neural activity is that it is periodic, enabling functional connectivity (FC) between distant regions through coupling of their oscillations. According to task-based studies, such oscillation-based FC is rapid and malleable to meet cognitive task demands. Studying distributed FC patterns instead of FC in a few individual connections, we found that oscillation-based FC is largely stable across various cognitive states and shares a common layout across oscillation frequencies. This stable spatial organization of FC in fast oscillatory brain signals parallels the known stability of fMRI-based intrinsic FC architecture. Despite the observed spatial state and frequency invariance, FC of individual connections was temporally independent between frequency bands, suggesting a putative mechanism for malleable frequency-specific FC to support cognitive tasks.
Collapse
|
19
|
Heeger DJ, Zemlianova KO. A recurrent circuit implements normalization, simulating the dynamics of V1 activity. Proc Natl Acad Sci U S A 2020; 117:22494-22505. [PMID: 32843341 PMCID: PMC7486719 DOI: 10.1073/pnas.2005417117] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
The normalization model has been applied to explain neural activity in diverse neural systems including primary visual cortex (V1). The model's defining characteristic is that the response of each neuron is divided by a factor that includes a weighted sum of activity of a pool of neurons. Despite the success of the normalization model, there are three unresolved issues. 1) Experimental evidence supports the hypothesis that normalization in V1 operates via recurrent amplification, i.e., amplifying weak inputs more than strong inputs. It is unknown how normalization arises from recurrent amplification. 2) Experiments have demonstrated that normalization is weighted such that each weight specifies how one neuron contributes to another's normalization pool. It is unknown how weighted normalization arises from a recurrent circuit. 3) Neural activity in V1 exhibits complex dynamics, including gamma oscillations, linked to normalization. It is unknown how these dynamics emerge from normalization. Here, a family of recurrent circuit models is reported, each of which comprises coupled neural integrators to implement normalization via recurrent amplification with arbitrary normalization weights, some of which can recapitulate key experimental observations of the dynamics of neural activity in V1.
Collapse
Affiliation(s)
- David J Heeger
- Department of Psychology, New York University, New York, NY 10003;
- Center for Neural Science, New York University, New York, NY 10003
| | | |
Collapse
|
20
|
Bartoli E, Bosking W, Foster BL. Seeing Visual Gamma Oscillations in a New Light. Trends Cogn Sci 2020; 24:501-503. [PMID: 32336605 DOI: 10.1016/j.tics.2020.03.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Revised: 03/23/2020] [Accepted: 03/30/2020] [Indexed: 10/24/2022]
Abstract
Gamma oscillations have been argued to support visual perception by synchronizing the processing and transfer of information within and across areas of visual cortex. Here, we highlight recent findings implicating the influence of color on visual gamma oscillations and how these observations may relate to local cortical tuning and organization.
Collapse
Affiliation(s)
- Eleonora Bartoli
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - William Bosking
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Brett L Foster
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA; Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA.
| |
Collapse
|
21
|
Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex. J Neurosci 2020; 40:2430-2444. [PMID: 32066581 DOI: 10.1523/jneurosci.1368-19.2020] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Revised: 02/08/2020] [Accepted: 02/10/2020] [Indexed: 12/21/2022] Open
Abstract
Neural signals recorded at different scales contain information about environment and behavior and have been used to control Brain Machine Interfaces with varying degrees of success. However, a direct comparison of their efficacy has not been possible due to different recording setups, tasks, species, etc. To address this, we implanted customized arrays having both microelectrodes and electrocorticogram (ECoG) electrodes in the primary visual cortex of 2 female macaque monkeys, and also recorded electroencephalogram (EEG), while they viewed a variety of naturalistic images and parametric gratings. Surprisingly, ECoG had higher information and decodability than all other signals. Combining a few ECoG electrodes allowed more accurate decoding than combining a much larger number of microelectrodes. Control analyses showed that higher decoding accuracy of ECoG compared with local field potential was not because of differences in low-level visual features captured by them but instead because of larger spatial summation of the ECoG. Information was high in the 30-80 Hz range and at lower frequencies. Information in different frequencies and scales was nonredundant. These results have strong implications for Brain Machine Interface applications and for study of population representation of visual stimuli.SIGNIFICANCE STATEMENT Electrophysiological signals captured across scales by different recording electrodes are regularly used for Brain Machine Interfaces, but the information content varies due to electrode size and location. A systematic comparison of their efficiency for Brain Machine Interfaces is important but technically challenging. Here, we recorded simultaneous signals across four scales: spikes, local field potential, electrocorticogram (ECoG), and EEG, and compared their information and decoding accuracy for a large variety of naturalistic stimuli. We found that ECoGs were highly informative and outperformed other signals in information content and decoding accuracy.
Collapse
|
22
|
Fritsche M, Lawrence SJD, de Lange FP. Temporal tuning of repetition suppression across the visual cortex. J Neurophysiol 2019; 123:224-233. [PMID: 31774368 DOI: 10.1152/jn.00582.2019] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The visual system adapts to its recent history. A phenomenon related to this is repetition suppression (RS), a reduction in neural responses to repeated compared with nonrepeated visual input. An intriguing hypothesis is that the timescale over which RS occurs across the visual hierarchy is tuned to the temporal statistics of visual input features, which change rapidly in low-level areas but are more stable in higher level areas. Here, we tested this hypothesis by studying the influence of the temporal lag between successive visual stimuli on RS throughout the visual system using functional (f)MRI. Twelve human volunteers engaged in four fMRI sessions in which we characterized the blood oxygen level-dependent response to pairs of repeated and nonrepeated natural images with interstimulus intervals (ISI) ranging from 50 to 1,000 ms to quantify the temporal tuning of RS along the posterior-anterior axis of the visual system. As expected, RS was maximal for short ISIs and decayed with increasing ISI. Crucially, however, and against our hypothesis, RS decayed at a similar rate in early and late visual areas. This finding challenges the prevailing view that the timescale of RS increases along the posterior-anterior axis of the visual system and suggests that RS is not tuned to temporal input regularities.NEW & NOTEWORTHY Visual areas show reduced neural responses to repeated compared with nonrepeated visual input, a phenomenon termed repetition suppression (RS). Here we show that RS decays at a similar rate in low- and high-level visual areas, suggesting that the short-term decay of RS across the visual hierarchy is not tuned to temporal input regularities. This may limit the specificity with which the mechanisms underlying RS could optimize the processing of input features across the visual hierarchy.
Collapse
Affiliation(s)
- Matthias Fritsche
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Samuel J D Lawrence
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|