1
|
Meyerolbersleben LS, Sirota A, Busse L. Anatomically resolved oscillatory bursts reveal dynamic motifs of thalamocortical activity during naturalistic stimulus viewing. Neuron 2025:S0896-6273(25)00250-8. [PMID: 40252643 DOI: 10.1016/j.neuron.2025.03.030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2024] [Revised: 02/02/2025] [Accepted: 03/25/2025] [Indexed: 04/21/2025]
Abstract
Natural vision requires circuit mechanisms which process complex spatiotemporal stimulus features in parallel. In the mammalian forebrain, one signature of circuit activation is fast oscillatory dynamics, reflected in the local field potential (LFP). Using data from the Allen Neuropixels Visual Coding project, we show that local visual features in naturalistic stimuli induce in mouse primary visual cortex (V1) retinotopically specific oscillations in various frequency bands and V1 layers. Specifically, layer 4 (L4) narrowband gamma was linked to luminance, low-gamma to optic flow, and L4/L5 epsilon oscillations to contrast. These feature-specific oscillations were associated with distinct translaminar spike-phase coupling patterns, which were conserved across a range of stimuli containing the relevant visual features, suggesting that they might constitute feature-specific circuit motifs. Our findings highlight visually induced fast oscillations as markers of dynamic circuit motifs, which may support differential and multiplexed coding of complex visual input and thalamocortical information propagation.
Collapse
Affiliation(s)
- Lukas Sebastian Meyerolbersleben
- Division of Neurobiology, Faculty of Biology, LMU Munich, 82152 Planegg-Martinsried, Germany; Graduate School of Systemic Neurosciences (GSN), LMU Munich, 82152 Planegg-Martinsried, Germany
| | - Anton Sirota
- Division of Neurobiology, Faculty of Biology, LMU Munich, 82152 Planegg-Martinsried, Germany; Bernstein Center for Computational Neuroscience, 82152 Planegg-Martinsried, Germany.
| | - Laura Busse
- Division of Neurobiology, Faculty of Biology, LMU Munich, 82152 Planegg-Martinsried, Germany; Bernstein Center for Computational Neuroscience, 82152 Planegg-Martinsried, Germany.
| |
Collapse
|
2
|
Gabhart KM, Xiong YS, Bastos AM. Predictive coding: a more cognitive process than we thought? Trends Cogn Sci 2025:S1364-6613(25)00030-0. [PMID: 39984365 DOI: 10.1016/j.tics.2025.01.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 01/22/2025] [Accepted: 01/27/2025] [Indexed: 02/23/2025]
Abstract
In predictive coding (PC), higher-order brain areas generate predictions that are sent to lower-order sensory areas. Top-down predictions are compared with bottom-up sensory data, and mismatches evoke prediction errors. In PC, the prediction errors are encoded in layer 2/3 pyramidal neurons of sensory cortex that feed forward. The PC model has been tested with multiple recording modalities using the global-local oddball paradigm. Consistent with PC, neuroimaging studies reported prediction error responses in sensory and higher-order areas. However, recent studies of neuronal spiking suggest that genuine prediction errors emerge in prefrontal cortex (PFC). This implies that predictive processing is a more cognitive than sensory-based mechanism - an observation that challenges PC and better aligns with a framework we call predictive routing (PR).
Collapse
Affiliation(s)
| | | | - André M Bastos
- Department of Psychology, Vanderbilt University, Nashville, TN, USA.
| |
Collapse
|
3
|
Vinck M, Uran C, Dowdall JR, Rummell B, Canales-Johnson A. Large-scale interactions in predictive processing: oscillatory versus transient dynamics. Trends Cogn Sci 2025; 29:133-148. [PMID: 39424521 PMCID: PMC7616854 DOI: 10.1016/j.tics.2024.09.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 09/17/2024] [Accepted: 09/26/2024] [Indexed: 10/21/2024]
Abstract
How do the two main types of neural dynamics, aperiodic transients and oscillations, contribute to the interactions between feedforward (FF) and feedback (FB) pathways in sensory inference and predictive processing? We discuss three theoretical perspectives. First, we critically evaluate the theory that gamma and alpha/beta rhythms play a role in classic hierarchical predictive coding (HPC) by mediating FF and FB communication, respectively. Second, we outline an alternative functional model in which rapid sensory inference is mediated by aperiodic transients, whereas oscillations contribute to the stabilization of neural representations over time and plasticity processes. Third, we propose that the strong dependence of oscillations on predictability can be explained based on a biologically plausible alternative to classic HPC, namely dendritic HPC.
Collapse
Affiliation(s)
- Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University, 6525 Nijmegen, The Netherlands.
| | - Cem Uran
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neurophysics, Radboud University, 6525 Nijmegen, The Netherlands.
| | - Jarrod R Dowdall
- Robarts Research Institute, Western University, London, ON, Canada
| | - Brian Rummell
- Ernst Strüngmann Institute (ESI) for Neuroscience, in Cooperation with the Max Planck Society, 60528 Frankfurt am Main, Germany
| | - Andres Canales-Johnson
- Facultad de Ciencias de la Salud, Universidad Catolica del Maule, 3480122 Talca, Chile; Department of Psychology, University of Cambridge, Cambridge CB2 3EB, UK.
| |
Collapse
|
4
|
Katsanevaki C, Bosman CA, Friston KJ, Fries P. Stimulus-repetition effects on macaque V1 and V4 microcircuits explain gamma-synchronization increase. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.12.06.627165. [PMID: 39713348 PMCID: PMC11661063 DOI: 10.1101/2024.12.06.627165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 12/24/2024]
Abstract
Under natural conditions, animals repeatedly encounter the same visual scenes, objects or patterns repeatedly. These repetitions constitute statistical regularities, which the brain captures in an internal model through learning. A signature of such learning in primate visual areas V1 and V4 is the gradual strengthening of gamma synchronization. We used a V1-V4 Dynamic Causal Model (DCM) to explain visually induced responses in early and late epochs from a sequence of several hundred grating presentations. The DCM reproduced the empirical increase in local and inter-areal gamma synchronization, revealing specific intrinsic connectivity effects that could explain the phenomenon. In a sensitivity analysis, the isolated modulation of several connection strengths induced increased gamma. Comparison of alternative models showed that empirical gamma increases are better explained by (1) repetition effects in both V1 and V4 intrinsic connectivity (alone or together with extrinsic) than in extrinsic connectivity alone, and (2) repetition effects on V1 and V4 population input rather than output gain. The best input gain model included effects in V1 granular and superficial excitatory populations and in V4 granular and deep excitatory populations. Our findings are consistent with gamma reflecting bottom-up signal precision, which increases with repetition and, therefore, with predictability and learning.
Collapse
Affiliation(s)
- Christini Katsanevaki
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany
- International Max Planck Research School for Neural Circuits, Frankfurt 60438, Germany
| | - Conrado A. Bosman
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen 6525 EN, the Netherlands
- Swammerdam Institute for Life Sciences, Center for Neuroscience, University of Amsterdam, Amsterdam 1098 XH, the Netherlands
| | - Karl J. Friston
- Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany
- International Max Planck Research School for Neural Circuits, Frankfurt 60438, Germany
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen 6525 EN, the Netherlands
- Max Planck Institute for Biological Cybernetics, 72076 Tübingen, Germany
| |
Collapse
|
5
|
Richter D, Kietzmann TC, de Lange FP. High-level visual prediction errors in early visual cortex. PLoS Biol 2024; 22:e3002829. [PMID: 39527555 PMCID: PMC11554119 DOI: 10.1371/journal.pbio.3002829] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 09/03/2024] [Indexed: 11/16/2024] Open
Abstract
Perception is shaped by both incoming sensory input and expectations derived from our prior knowledge. Numerous studies have shown stronger neural activity for surprising inputs, suggestive of predictive processing. However, it is largely unclear what predictions are made across the cortical hierarchy, and therefore what kind of surprise drives this up-regulation of activity. Here, we leveraged fMRI in human volunteers and deep neural network (DNN) models to arbitrate between 2 hypotheses: prediction errors may signal a local mismatch between input and expectation at each level of the cortical hierarchy, or prediction errors may be computed at higher levels and the resulting surprise signal is broadcast to earlier areas in the cortical hierarchy. Our results align with the latter hypothesis. Prediction errors in both low- and high-level visual cortex responded to high-level, but not low-level, visual surprise. This scaling with high-level surprise in early visual cortex strongly diverged from feedforward tuning. Combined, our results suggest that high-level predictions constrain sensory processing in earlier areas, thereby aiding perceptual inference.
Collapse
Affiliation(s)
- David Richter
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, the Netherlands
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
| | - Tim C. Kietzmann
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany
| | - Floris P. de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, the Netherlands
| |
Collapse
|
6
|
Chalas N, Meyer L, Lo CW, Park H, Kluger DS, Abbasi O, Kayser C, Nitsch R, Gross J. Dissociating prosodic from syntactic delta activity during natural speech comprehension. Curr Biol 2024; 34:3537-3549.e5. [PMID: 39047734 DOI: 10.1016/j.cub.2024.06.072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 06/24/2024] [Accepted: 06/27/2024] [Indexed: 07/27/2024]
Abstract
Decoding human speech requires the brain to segment the incoming acoustic signal into meaningful linguistic units, ranging from syllables and words to phrases. Integrating these linguistic constituents into a coherent percept sets the root of compositional meaning and hence understanding. One important cue for segmentation in natural speech is prosodic cues, such as pauses, but their interplay with higher-level linguistic processing is still unknown. Here, we dissociate the neural tracking of prosodic pauses from the segmentation of multi-word chunks using magnetoencephalography (MEG). We find that manipulating the regularity of pauses disrupts slow speech-brain tracking bilaterally in auditory areas (below 2 Hz) and in turn increases left-lateralized coherence of higher-frequency auditory activity at speech onsets (around 25-45 Hz). Critically, we also find that multi-word chunks-defined as short, coherent bundles of inter-word dependencies-are processed through the rhythmic fluctuations of low-frequency activity (below 2 Hz) bilaterally and independently of prosodic cues. Importantly, low-frequency alignment at chunk onsets increases the accuracy of an encoding model in bilateral auditory and frontal areas while controlling for the effect of acoustics. Our findings provide novel insights into the neural basis of speech perception, demonstrating that both acoustic features (prosodic cues) and abstract linguistic processing at the multi-word timescale are underpinned independently by low-frequency electrophysiological brain activity in the delta frequency range.
Collapse
Affiliation(s)
- Nikos Chalas
- Institute for Biomagnetism and Biosignal Analysis, University of Münster, Münster, Germany; Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany; Institute for Translational Neuroscience, University of Münster, Münster, Germany.
| | - Lars Meyer
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Chia-Wen Lo
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Hyojin Park
- Centre for Human Brain Health (CHBH), School of Psychology, University of Birmingham, Birmingham, UK
| | - Daniel S Kluger
- Institute for Biomagnetism and Biosignal Analysis, University of Münster, Münster, Germany; Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| | - Omid Abbasi
- Institute for Biomagnetism and Biosignal Analysis, University of Münster, Münster, Germany
| | - Christoph Kayser
- Department for Cognitive Neuroscience, Faculty of Biology, Bielefeld University, 33615 Bielefeld, Germany
| | - Robert Nitsch
- Institute for Translational Neuroscience, University of Münster, Münster, Germany
| | - Joachim Gross
- Institute for Biomagnetism and Biosignal Analysis, University of Münster, Münster, Germany; Otto-Creutzfeldt-Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| |
Collapse
|
7
|
Kanth ST, Ray S. Gamma Responses to Colored Natural Stimuli Can Be Predicted from Local Low-Level Stimulus Features. eNeuro 2024; 11:ENEURO.0417-23.2024. [PMID: 39054054 PMCID: PMC11277289 DOI: 10.1523/eneuro.0417-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 05/17/2024] [Accepted: 07/01/2024] [Indexed: 07/27/2024] Open
Abstract
The role of gamma rhythm (30-80 Hz) in visual processing is debated; stimuli like gratings and hue patches generate strong gamma, but many natural images do not. Could image gamma responses be predicted by approximating images as gratings or hue patches? Surprisingly, this question remains unanswered, since the joint dependence of gamma on multiple features is poorly understood. We recorded local field potentials and electrocorticogram from two female monkeys while presenting natural images and parametric stimuli varying along several feature dimensions. Gamma responses to different grating/hue features were separable, allowing for a multiplicative model based on individual features. By fitting a hue patch to the image around the receptive field, this simple model could predict gamma responses to chromatic images across scales with reasonably high accuracy. Our results provide a simple "baseline" model to predict gamma from local image properties, against which more complex models of natural vision can be tested.
Collapse
Affiliation(s)
- Sidrat Tasawoor Kanth
- IISc Mathematics Initiative, Indian Institute of Science, Bangalore 560012, India
- Center for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| | - Supratim Ray
- IISc Mathematics Initiative, Indian Institute of Science, Bangalore 560012, India
- Center for Neuroscience, Indian Institute of Science, Bangalore 560012, India
| |
Collapse
|
8
|
Bortolotti A, Conti A, Romagnoli A, Sacco PL. Imagination vs. routines: festive time, weekly time, and the predictive brain. Front Hum Neurosci 2024; 18:1357354. [PMID: 38736532 PMCID: PMC11082368 DOI: 10.3389/fnhum.2024.1357354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Accepted: 04/05/2024] [Indexed: 05/14/2024] Open
Abstract
This paper examines the relationship between societal structures shaped by traditions, norms, laws, and customs, and creative expressions in arts and media through the lens of the predictive coding framework in cognitive science. The article proposes that both dimensions of culture can be viewed as adaptations designed to enhance and train the brain's predictive abilities in the social domain. Traditions, norms, laws, and customs foster shared predictions and expectations among individuals, thereby reducing uncertainty in social environments. On the other hand, arts and media expose us to simulated experiences that explore alternative social realities, allowing the predictive machinery of the brain to hone its skills through exposure to a wider array of potentially relevant social circumstances and scenarios. We first review key principles of predictive coding and active inference, and then explore the rationale of cultural traditions and artistic culture in this perspective. Finally, we draw parallels between institutionalized normative habits that stabilize social worlds and creative and imaginative acts that temporarily subvert established conventions to inject variability.
Collapse
Affiliation(s)
- Alessandro Bortolotti
- Department of Neuroscience, Imaging, and Clinical Sciences, University “G. D'Annunzio” of Chieti-Pescara, Chieti, Italy
| | - Alice Conti
- Department of Neuroscience, Imaging, and Clinical Sciences, University “G. D'Annunzio” of Chieti-Pescara, Chieti, Italy
| | | | - Pier Luigi Sacco
- Department of Neuroscience, Imaging, and Clinical Sciences, University “G. D'Annunzio” of Chieti-Pescara, Chieti, Italy
- metaLAB (at) Harvard, Cambridge, MA, United States
| |
Collapse
|
9
|
Heins C, Millidge B, Da Costa L, Mann RP, Friston KJ, Couzin ID. Collective behavior from surprise minimization. Proc Natl Acad Sci U S A 2024; 121:e2320239121. [PMID: 38630721 PMCID: PMC11046639 DOI: 10.1073/pnas.2320239121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 03/08/2024] [Indexed: 04/19/2024] Open
Abstract
Collective motion is ubiquitous in nature; groups of animals, such as fish, birds, and ungulates appear to move as a whole, exhibiting a rich behavioral repertoire that ranges from directed movement to milling to disordered swarming. Typically, such macroscopic patterns arise from decentralized, local interactions among constituent components (e.g., individual fish in a school). Preeminent models of this process describe individuals as self-propelled particles, subject to self-generated motion and "social forces" such as short-range repulsion and long-range attraction or alignment. However, organisms are not particles; they are probabilistic decision-makers. Here, we introduce an approach to modeling collective behavior based on active inference. This cognitive framework casts behavior as the consequence of a single imperative: to minimize surprise. We demonstrate that many empirically observed collective phenomena, including cohesion, milling, and directed motion, emerge naturally when considering behavior as driven by active Bayesian inference-without explicitly building behavioral rules or goals into individual agents. Furthermore, we show that active inference can recover and generalize the classical notion of social forces as agents attempt to suppress prediction errors that conflict with their expectations. By exploring the parameter space of the belief-based model, we reveal nontrivial relationships between the individual beliefs and group properties like polarization and the tendency to visit different collective states. We also explore how individual beliefs about uncertainty determine collective decision-making accuracy. Finally, we show how agents can update their generative model over time, resulting in groups that are collectively more sensitive to external fluctuations and encode information more robustly.
Collapse
Affiliation(s)
- Conor Heins
- Department of Collective Behaviour, Max Planck Institute of Animal Behavior, KonstanzD-78457, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, KonstanzD-78457, Germany
- Department of Biology, University of Konstanz, KonstanzD-78457, Germany
- VERSES Research Lab, Los Angeles, CA90016
| | - Beren Millidge
- Medical Research Council Brain Networks Dynamics Unit, University of Oxford, OxfordOX1 3TH, United Kingdom
| | - Lancelot Da Costa
- VERSES Research Lab, Los Angeles, CA90016
- Department of Mathematics, Imperial College London, LondonSW7 2AZ, United Kingdom
- Wellcome Centre for Human Neuroimaging, University College London, LondonWC1N 3AR, United Kingdom
| | - Richard P. Mann
- Department of Statistics, School of Mathematics, University of Leeds, LeedsLS2 9JT, United Kingdom
| | - Karl J. Friston
- VERSES Research Lab, Los Angeles, CA90016
- Wellcome Centre for Human Neuroimaging, University College London, LondonWC1N 3AR, United Kingdom
| | - Iain D. Couzin
- Department of Collective Behaviour, Max Planck Institute of Animal Behavior, KonstanzD-78457, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, KonstanzD-78457, Germany
- Department of Biology, University of Konstanz, KonstanzD-78457, Germany
| |
Collapse
|
10
|
Liu P, Bo K, Ding M, Fang R. Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects. PLoS Comput Biol 2024; 20:e1011943. [PMID: 38547053 PMCID: PMC10977720 DOI: 10.1371/journal.pcbi.1011943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 02/24/2024] [Indexed: 04/02/2024] Open
Abstract
Recent neuroimaging studies have shown that the visual cortex plays an important role in representing the affective significance of visual input. The origin of these affect-specific visual representations is debated: they are intrinsic to the visual system versus they arise through reentry from frontal emotion processing structures such as the amygdala. We examined this problem by combining convolutional neural network (CNN) models of the human ventral visual cortex pre-trained on ImageNet with two datasets of affective images. Our results show that in all layers of the CNN models, there were artificial neurons that responded consistently and selectively to neutral, pleasant, or unpleasant images and lesioning these neurons by setting their output to zero or enhancing these neurons by increasing their gain led to decreased or increased emotion recognition performance respectively. These results support the idea that the visual system may have the intrinsic ability to represent the affective significance of visual input and suggest that CNNs offer a fruitful platform for testing neuroscientific theories.
Collapse
Affiliation(s)
- Peng Liu
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, United States of America
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire, United States of America
| | - Ke Bo
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire, United States of America
| | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, United States of America
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, United States of America
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, Florida, United States of America
| |
Collapse
|
11
|
Yiling Y, Klon-Lipok J, Shapcott K, Lazar A, Singer W. Dynamic fading memory and expectancy effects in the monkey primary visual cortex. Proc Natl Acad Sci U S A 2024; 121:e2314855121. [PMID: 38354261 PMCID: PMC10895277 DOI: 10.1073/pnas.2314855121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/10/2024] [Indexed: 02/16/2024] Open
Abstract
In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.
Collapse
Affiliation(s)
- Yang Yiling
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Johanna Klon-Lipok
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
| | - Katharine Shapcott
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Andreea Lazar
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Wolf Singer
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
- Frankfurt Institute for Advanced Studies, Frankfurt am Main60438, Germany
| |
Collapse
|
12
|
Lazar A, Klein L, Klon-Lipok J, Bányai M, Orbán G, Singer W. Paying attention to natural scenes in area V1. iScience 2024; 27:108816. [PMID: 38323011 PMCID: PMC10844823 DOI: 10.1016/j.isci.2024.108816] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 07/18/2023] [Accepted: 01/02/2024] [Indexed: 02/08/2024] Open
Abstract
Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesized that attentional and contextual signals interact in V1 in a manner that primarily benefits the representation of natural stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes, but not by synthetic stimuli lacking higher-order statistical regularities. Population analysis revealed that neuronal responses converged to a low-dimensional subspace only for natural stimuli. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the natural-scene subspace, indicating an alignment between the attentional and natural stimulus variance. These results suggest that attentional and contextual signals interact in V1 in a manner optimized for natural vision.
Collapse
Affiliation(s)
- Andreea Lazar
- Ernst Strüngmann Institute, Frankfurt am Main, Germany
- Max-Planck Institute for Neuroscience, Frankfurt am Main, Germany
| | - Liane Klein
- Ernst Strüngmann Institute, Frankfurt am Main, Germany
- Max-Planck Institute for Neuroscience, Frankfurt am Main, Germany
| | - Johanna Klon-Lipok
- Ernst Strüngmann Institute, Frankfurt am Main, Germany
- Max-Planck Institute for Neuroscience, Frankfurt am Main, Germany
| | - Mihály Bányai
- HUN-REN Wigner Research Center for Physics, Budapest, Hungary
| | - Gergő Orbán
- HUN-REN Wigner Research Center for Physics, Budapest, Hungary
| | - Wolf Singer
- Ernst Strüngmann Institute, Frankfurt am Main, Germany
- Max-Planck Institute for Neuroscience, Frankfurt am Main, Germany
| |
Collapse
|
13
|
Park WJ, Fine I. A unified model for cross-modal plasticity and skill acquisition. Front Neurosci 2024; 18:1334283. [PMID: 38384481 PMCID: PMC10879418 DOI: 10.3389/fnins.2024.1334283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 01/22/2024] [Indexed: 02/23/2024] Open
Abstract
Historically, cross-modal plasticity following early blindness has been largely studied in the context of visual deprivation. However, more recently, there has been a shift in focus towards understanding cross-modal plasticity from the perspective of skill acquisition: the striking plasticity observed in early blind individuals reflects the extraordinary perceptual and cognitive challenges they solve. Here, inspired by two seminal papers on skill learning (the "cortical recycling" theory) and cross-modal plasticity (the "metamodal" hypothesis) respectively, we present a unified hypothesis of cortical specialization that describes how shared functional, algorithmic, and structural constraints might mediate both types of plasticity.
Collapse
Affiliation(s)
- Woon Ju Park
- Department of Psychology, University of Washington, Seattle, WA, United States
- Center for Human Neuroscience, University of Washington, Seattle, WA, United States
| | - Ione Fine
- Department of Psychology, University of Washington, Seattle, WA, United States
- Center for Human Neuroscience, University of Washington, Seattle, WA, United States
| |
Collapse
|
14
|
Shipp S. Computational components of visual predictive coding circuitry. Front Neural Circuits 2024; 17:1254009. [PMID: 38259953 PMCID: PMC10800426 DOI: 10.3389/fncir.2023.1254009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 12/13/2023] [Indexed: 01/24/2024] Open
Abstract
If a full visual percept can be said to be a 'hypothesis', so too can a neural 'prediction' - although the latter addresses one particular component of image content (such as 3-dimensional organisation, the interplay between lighting and surface colour, the future trajectory of moving objects, and so on). And, because processing is hierarchical, predictions generated at one level are conveyed in a backward direction to a lower level, seeking to predict, in fact, the neural activity at that prior stage of processing, and learning from errors signalled in the opposite direction. This is the essence of 'predictive coding', at once an algorithm for information processing and a theoretical basis for the nature of operations performed by the cerebral cortex. Neural models for the implementation of predictive coding invoke specific functional classes of neuron for generating, transmitting and receiving predictions, and for producing reciprocal error signals. Also a third general class, 'precision' neurons, tasked with regulating the magnitude of error signals contingent upon the confidence placed upon the prediction, i.e., the reliability and behavioural utility of the sensory data that it predicts. So, what is the ultimate source of a 'prediction'? The answer is multifactorial: knowledge of the current environmental context and the immediate past, allied to memory and lifetime experience of the way of the world, doubtless fine-tuned by evolutionary history too. There are, in consequence, numerous potential avenues for experimenters seeking to manipulate subjects' expectation, and examine the neural signals elicited by surprising, and less surprising visual stimuli. This review focuses upon the predictive physiology of mouse and monkey visual cortex, summarising and commenting on evidence to date, and placing it in the context of the broader field. It is concluded that predictive coding has a firm grounding in basic neuroscience and that, unsurprisingly, there remains much to learn.
Collapse
Affiliation(s)
- Stewart Shipp
- Institute of Ophthalmology, University College London, London, United Kingdom
| |
Collapse
|
15
|
Yan Y, Zhan J, Garrod O, Cui X, Ince RAA, Schyns PG. Strength of predicted information content in the brain biases decision behavior. Curr Biol 2023; 33:5505-5514.e6. [PMID: 38065096 DOI: 10.1016/j.cub.2023.10.042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 10/11/2023] [Accepted: 10/23/2023] [Indexed: 12/21/2023]
Abstract
Prediction-for-perception theories suggest that the brain predicts incoming stimuli to facilitate their categorization.1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17 However, it remains unknown what the information contents of these predictions are, which hinders mechanistic explanations. This is because typical approaches cast predictions as an underconstrained contrast between two categories18,19,20,21,22,23,24-e.g., faces versus cars, which could lead to predictions of features specific to faces or cars, or features from both categories. Here, to pinpoint the information contents of predictions and thus their mechanistic processing in the brain, we identified the features that enable two different categorical perceptions of the same stimuli. We then trained multivariate classifiers to discern, from dynamic MEG brain responses, the features tied to each perception. With an auditory cueing design, we reveal where, when, and how the brain reactivates visual category features (versus the typical category contrast) before the stimulus is shown. We demonstrate that the predictions of category features have a more direct influence (bias) on subsequent decision behavior in participants than the typical category contrast. Specifically, these predictions are more precisely localized in the brain (lateralized), are more specifically driven by the auditory cues, and their reactivation strength before a stimulus presentation exerts a greater bias on how the individual participant later categorizes this stimulus. By characterizing the specific information contents that the brain predicts and then processes, our findings provide new insights into the brain's mechanisms of prediction for perception.
Collapse
Affiliation(s)
- Yuening Yan
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Jiayu Zhan
- School of Psychological and Cognitive Sciences, Peking University, 5 Yiheyuan Road, Beijing 100871, China
| | - Oliver Garrod
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Xuan Cui
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Robin A A Ince
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Philippe G Schyns
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK.
| |
Collapse
|
16
|
Vessel EA, Pasqualette L, Uran C, Koldehoff S, Bignardi G, Vinck M. Self-Relevance Predicts the Aesthetic Appeal of Real and Synthetic Artworks Generated via Neural Style Transfer. Psychol Sci 2023; 34:1007-1023. [PMID: 37578091 PMCID: PMC7616853 DOI: 10.1177/09567976231188107] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/15/2023] Open
Abstract
What determines the aesthetic appeal of artworks? Recent work suggests that aesthetic appeal can, to some extent, be predicted from a visual artwork's image features. Yet a large fraction of variance in aesthetic ratings remains unexplained and may relate to individual preferences. We hypothesized that an artwork's aesthetic appeal depends strongly on self-relevance. In a first study (N = 33 adults, online replication N = 208), rated aesthetic appeal for real artworks was positively predicted by rated self-relevance. In a second experiment (N = 45 online), we created synthetic, self-relevant artworks using deep neural networks that transferred the style of existing artworks to photographs. Style transfer was applied to self-relevant photographs selected to reflect participant-specific attributes such as autobiographical memories. Self-relevant, synthetic artworks were rated as more aesthetically appealing than matched control images, at a level similar to human-made artworks. Thus, self-relevance is a key determinant of aesthetic appeal, independent of artistic skill and image features.
Collapse
Affiliation(s)
- Edward A. Vessel
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics
| | - Laura Pasqualette
- Neurocognitive Developmental Psychology, Friedrich-Alexander University Erlangen-Nürnberg
| | - Cem Uran
- Ernst Strüngmann Institute
- Department of Neurophysics, Donders Centre for Neuroscience
| | - Sarah Koldehoff
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics
| | - Giacomo Bignardi
- Department of Language and Genetics, Max Planck Institute for Psycholinguistics
- Max Planck School of Cognition
| | - Martin Vinck
- Ernst Strüngmann Institute
- Department of Neurophysics, Donders Centre for Neuroscience
| |
Collapse
|
17
|
Perrenoud Q, Cardin JA. Beyond rhythm - a framework for understanding the frequency spectrum of neural activity. Front Syst Neurosci 2023; 17:1217170. [PMID: 37719024 PMCID: PMC10500127 DOI: 10.3389/fnsys.2023.1217170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 08/14/2023] [Indexed: 09/19/2023] Open
Abstract
Cognitive and behavioral processes are often accompanied by changes within well-defined frequency bands of the local field potential (LFP i.e., the voltage induced by neuronal activity). These changes are detectable in the frequency domain using the Fourier transform and are often interpreted as neuronal oscillations. However, aside some well-known exceptions, the processes underlying such changes are difficult to track in time, making their oscillatory nature hard to verify. In addition, many non-periodic neural processes can also have spectra that emphasize specific frequencies. Thus, the notion that spectral changes reflect oscillations is likely too restrictive. In this study, we use a simple yet versatile framework to understand the frequency spectra of neural recordings. Using simulations, we derive the Fourier spectra of periodic, quasi-periodic and non-periodic neural processes having diverse waveforms, illustrating how these attributes shape their spectral signatures. We then show how neural processes sum their energy in the local field potential in simulated and real-world recording scenarios. We find that the spectral power of neural processes is essentially determined by two aspects: (1) the distribution of neural events in time and (2) the waveform of the voltage induced by single neural events. Taken together, this work guides the interpretation of the Fourier spectrum of neural recordings and indicates that power increases in specific frequency bands do not necessarily reflect periodic neural activity.
Collapse
Affiliation(s)
- Quentin Perrenoud
- Department of Neuroscience, Yale School of Medicine, Kavli Institute for Neuroscience, Wu Tsai Institute, New Haven, CT, United States
| | | |
Collapse
|
18
|
Saponati M, Vinck M. Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule. Nat Commun 2023; 14:4985. [PMID: 37604825 PMCID: PMC10442404 DOI: 10.1038/s41467-023-40651-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 08/03/2023] [Indexed: 08/23/2023] Open
Abstract
Intelligent behavior depends on the brain's ability to anticipate future events. However, the learning rules that enable neurons to predict and fire ahead of sensory inputs remain largely unknown. We propose a plasticity rule based on predictive processing, where the neuron learns a low-rank model of the synaptic input dynamics in its membrane potential. Neurons thereby amplify those synapses that maximally predict other synaptic inputs based on their temporal relations, which provide a solution to an optimization problem that can be implemented at the single-neuron level using only local information. Consequently, neurons learn sequences over long timescales and shift their spikes towards the first inputs in a sequence. We show that this mechanism can explain the development of anticipatory signalling and recall in a recurrent network. Furthermore, we demonstrate that the learning rule gives rise to several experimentally observed STDP (spike-timing-dependent plasticity) mechanisms. These findings suggest prediction as a guiding principle to orchestrate learning and synaptic plasticity in single neurons.
Collapse
Affiliation(s)
- Matteo Saponati
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt Am Main, Germany.
- IMPRS for Neural Circuits, Max-Planck Institute for Brain Research, 60438, Frankfurt Am Main, Germany.
- Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University, 6525, Nijmegen, The Netherlands.
| | - Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt Am Main, Germany.
- Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University, 6525, Nijmegen, The Netherlands.
| |
Collapse
|
19
|
Schneider M, Tzanou A, Uran C, Vinck M. Cell-type-specific propagation of visual flicker. Cell Rep 2023; 42:112492. [PMID: 37195864 PMCID: PMC7617239 DOI: 10.1016/j.celrep.2023.112492] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Revised: 03/10/2023] [Accepted: 04/24/2023] [Indexed: 05/19/2023] Open
Abstract
Rhythmic flicker stimulation has gained interest as a treatment for neurodegenerative diseases and as a method for frequency tagging neural activity. Yet, little is known about the way in which flicker-induced synchronization propagates across cortical levels and impacts different cell types. Here, we use Neuropixels to record from the lateral geniculate nucleus (LGN), the primary visual cortex (V1), and CA1 in mice while presenting visual flicker stimuli. LGN neurons show strong phase locking up to 40 Hz, whereas phase locking is substantially weaker in V1 and is absent in CA1. Laminar analyses reveal an attenuation of phase locking at 40 Hz for each processing stage. Gamma-rhythmic flicker predominantly entrains fast-spiking interneurons. Optotagging experiments show that these neurons correspond to either parvalbumin (PV+) or narrow-waveform somatostatin (Sst+) neurons. A computational model can explain the observed differences based on the neurons' capacitative low-pass filtering properties. In summary, the propagation of synchronized activity and its effect on distinct cell types strongly depend on its frequency.
Collapse
Affiliation(s)
- Marius Schneider
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands.
| | - Athanasia Tzanou
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany
| | - Cem Uran
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands
| | - Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt am Main, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 Nijmegen, the Netherlands.
| |
Collapse
|
20
|
Perrenoud Q, Cardin JA. Beyond rhythm - A framework for understanding the frequency spectrum of neural activity. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.12.540559. [PMID: 37215044 PMCID: PMC10197620 DOI: 10.1101/2023.05.12.540559] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Cognitive and behavioral processes are often accompanied by changes within well-defined frequency bands of the local field potential (LFP i.e., the voltage induced by neuronal activity). These changes are detectable in the frequency domain using the Fourier transform and are often interpreted as neuronal oscillations. However, aside some well-known exceptions, the processes underlying such changes are difficult to track in time, making their oscillatory nature hard to verify. In addition, many non-periodic neural processes can also have spectra that emphasize specific frequencies. Thus, the notion that spectral changes reflect oscillations is likely too restrictive. In this study, we propose a simple yet versatile framework to understand the frequency spectra of neural recordings. Using simulations, we derive the Fourier spectra of periodic, quasi-periodic and non-periodic neural processes having diverse waveforms, illustrating how these attributes shape their spectral signatures. We then show how neural processes sum their energy in the local field potential in simulated and real-world recording scenarios. We find that the spectral power of neural processes is essentially determined by two aspects: 1) the distribution of neural events in time and 2) the waveform of the voltage induced by single neural events. Taken together, this work guides the interpretation of the Fourier spectrum of neural recordings and indicates that power increases in specific frequency bands do not necessarily reflect periodic neural activity.
Collapse
Affiliation(s)
- Quentin Perrenoud
- Department of Neuroscience, Kavli Institute for Neuroscience, Wu Tsai Institute, Yale University School of Medicine, New Haven, CT, USA
| | - Jessica A. Cardin
- Department of Neuroscience, Kavli Institute for Neuroscience, Wu Tsai Institute, Yale University School of Medicine, New Haven, CT, USA
| |
Collapse
|
21
|
Gamma oscillations provide insights into cortical circuit development. Pflugers Arch 2023; 475:561-568. [PMID: 36864347 PMCID: PMC10105678 DOI: 10.1007/s00424-023-02801-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 03/04/2023]
Abstract
Rhythmic coordination in gamma oscillations provides temporal structure to neuronal activity. Gamma oscillations are commonly observed in the mammalian cerebral cortex, are altered early on in several neuropsychiatric disorders, and provide insights into the development of underlying cortical networks. However, a lack of knowledge on the developmental trajectory of gamma oscillations prevented the combination of findings from the immature and the adult brain. This review is intended to provide an overview on the development of cortical gamma oscillations, the maturation of the underlying network, and the implications for cortical function and dysfunction. The majority of information is drawn from work in rodents with particular emphasis on the prefrontal cortex, the developmental trajectory of gamma oscillations, and potential implications for neuropsychiatric disorders. Current evidence supports the idea that fast oscillations during development are indeed an immature form of adult gamma oscillations and can help us understand the pathology of neuropsychiatric disorders.
Collapse
|
22
|
Putting the brakes on synchrony: VIP interneurons tune visually evoked rhythmic activity. Neuron 2023; 111:297-299. [PMID: 36731427 DOI: 10.1016/j.neuron.2023.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Visually evoked synchrony in the primary visual cortex has proven to be a robust model for examining circuit interactions. In this issue of Neuron, Veit et al.1 highlight a previously unappreciated role for VIP interneurons in regulating local and long-range patterns of coordinated neural activity.
Collapse
|
23
|
Graham DJ. Nine insights from internet engineering that help us understand brain network communication. FRONTIERS IN COMPUTER SCIENCE 2023. [DOI: 10.3389/fcomp.2022.976801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
Philosophers have long recognized the value of metaphor as a tool that opens new avenues of investigation. By seeing brains as having the goal of representation, the computer metaphor in its various guises has helped systems neuroscience approach a wide array of neuronal behaviors at small and large scales. Here I advocate a complementary metaphor, the internet. Adopting this metaphor shifts our focus from computing to communication, and from seeing neuronal signals as localized representational elements to seeing neuronal signals as traveling messages. In doing so, we can take advantage of a comparison with the internet's robust and efficient routing strategies to understand how the brain might meet the challenges of network communication. I lay out nine engineering strategies that help the internet solve routing challenges similar to those faced by brain networks. The internet metaphor helps us by reframing neuronal activity across the brain as, in part, a manifestation of routing, which may, in different parts of the system, resemble the internet more, less, or not at all. I describe suggestive evidence consistent with the brain's use of internet-like routing strategies and conclude that, even if empirical data do not directly implicate internet-like routing, the metaphor is valuable as a reference point for those investigating the difficult problem of network communication in the brain and in particular the problem of routing.
Collapse
|
24
|
de Lange FP, Schmitt LM, Heilbron M. Reconstructing the predictive architecture of the mind and brain. Trends Cogn Sci 2022; 26:1018-1019. [PMID: 36150970 DOI: 10.1016/j.tics.2022.08.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 06/18/2022] [Accepted: 08/15/2022] [Indexed: 01/12/2023]
Abstract
Predictive processing has become an influential framework in cognitive neuroscience. However, it often lacks specificity and direct empirical support. How can we probe the nature and limits of the predictive brain? We highlight the potential of recent advances in artificial intelligence (AI) for providing a richer and more computationally explicit test of this theory of cortical function.
Collapse
Affiliation(s)
- Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Kapittelweg 29, 6525, EN, Nijmegen, The Netherlands.
| | - Lea-Maria Schmitt
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Kapittelweg 29, 6525, EN, Nijmegen, The Netherlands
| | - Micha Heilbron
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Kapittelweg 29, 6525, EN, Nijmegen, The Netherlands
| |
Collapse
|
25
|
Aligning evidence for the genesis of visual gamma oscillations. PLoS Biol 2022; 20:e3001701. [PMID: 35763497 PMCID: PMC9239443 DOI: 10.1371/journal.pbio.3001701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
|
26
|
Shirhatti V, Ravishankar P, Ray S. Gamma oscillations in primate primary visual cortex are severely attenuated by small stimulus discontinuities. PLoS Biol 2022; 20:e3001666. [PMID: 35700175 PMCID: PMC9197048 DOI: 10.1371/journal.pbio.3001666] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 05/10/2022] [Indexed: 11/22/2022] Open
Abstract
Gamma oscillations (30 to 80 Hz) have been hypothesized to play an important role in feature binding, based on the observation that continuous long bars induce stronger gamma in the visual cortex than bars with a small gap. Recently, many studies have shown that natural images, which have discontinuities in several low-level features, do not induce strong gamma oscillations, questioning their role in feature binding. However, the effect of different discontinuities on gamma has not been well studied. To address this, we recorded spikes and local field potential from 2 monkeys while they were shown gratings with discontinuities in 4 attributes: space, orientation, phase, or contrast. We found that while these discontinuities only had a modest effect on spiking activity, gamma power drastically reduced in all cases, suggesting that gamma could be a resonant phenomenon. An excitatory–inhibitory population model with stimulus-tuned recurrent inputs showed such resonant properties. Therefore, gamma could be a signature of excitation–inhibition balance, which gets disrupted due to discontinuities. Gamma oscillations (30-80 Hz) in visual cortex have been hypothesized to play an important role in feature binding, but this role has recently been questioned. This study shows that visual stimulus-induced gamma oscillations are highly attenuated with even small discontinuities in the stimulus. This "resonant" behaviour can be explained by a simple excitatory-inhibitory model in which discontinuities lead to a small reduction in lateral inputs.
Collapse
Affiliation(s)
- Vinay Shirhatti
- Centre for Neuroscience, Indian Institute of Science, Bengaluru, India
- IISc Mathematics Initiative, Indian Institute of Science, Bengaluru, India
| | | | - Supratim Ray
- Centre for Neuroscience, Indian Institute of Science, Bengaluru, India
- IISc Mathematics Initiative, Indian Institute of Science, Bengaluru, India
- * E-mail:
| |
Collapse
|
27
|
Stauch BJ, Peter A, Ehrlich I, Nolte Z, Fries P. Human visual gamma for color stimuli. eLife 2022; 11:e75897. [PMID: 35532123 PMCID: PMC9122493 DOI: 10.7554/elife.75897] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
Strong gamma-band oscillations in primate early visual cortex can be induced by homogeneous color surfaces (Peter et al., 2019; Shirhatti and Ray, 2018). Compared to other hues, particularly strong gamma oscillations have been reported for red stimuli. However, precortical color processing and the resultant strength of input to V1 have often not been fully controlled for. Therefore, stronger responses to red might be due to differences in V1 input strength. We presented stimuli that had equal luminance and cone contrast levels in a color coordinate system based on responses of the lateral geniculate nucleus, the main input source for area V1. With these stimuli, we recorded magnetoencephalography in 30 human participants. We found gamma oscillations in early visual cortex which, contrary to previous reports, did not differ between red and green stimuli of equal L-M cone contrast. Notably, blue stimuli with contrast exclusively on the S-cone axis induced very weak gamma responses, as well as smaller event-related fields and poorer change-detection performance. The strength of human color gamma responses for stimuli on the L-M axis could be well explained by L-M cone contrast and did not show a clear red bias when L-M cone contrast was properly equalized.
Collapse
Affiliation(s)
- Benjamin J Stauch
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Brain Imaging Center, Goethe University FrankfurtFrankfurtGermany
| | - Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
| | - Isabelle Ehrlich
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- Department of Psychology, Goethe University FrankfurtFrankfurtGermany
| | - Zora Nolte
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Donders Institute for Brain, Cognition and Behaviour, Radboud University NijmegenNijmegenNetherlands
| |
Collapse
|