1
|
Polyakov D, Robinson PA, Muller EJ, Shriki O. Recruiting neural field theory for data augmentation in a motor imagery brain-computer interface. Front Robot AI 2024; 11:1362735. [PMID: 38694882 PMCID: PMC11061403 DOI: 10.3389/frobt.2024.1362735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 03/20/2024] [Indexed: 05/04/2024] Open
Abstract
We introduce a novel approach to training data augmentation in brain-computer interfaces (BCIs) using neural field theory (NFT) applied to EEG data from motor imagery tasks. BCIs often suffer from limited accuracy due to a limited amount of training data. To address this, we leveraged a corticothalamic NFT model to generate artificial EEG time series as supplemental training data. We employed the BCI competition IV '2a' dataset to evaluate this augmentation technique. For each individual, we fitted the model to common spatial patterns of each motor imagery class, jittered the fitted parameters, and generated time series for data augmentation. Our method led to significant accuracy improvements of over 2% in classifying the "total power" feature, but not in the case of the "Higuchi fractal dimension" feature. This suggests that the fit NFT model may more favorably represent one feature than the other. These findings pave the way for further exploration of NFT-based data augmentation, highlighting the benefits of biophysically accurate artificial data.
Collapse
Affiliation(s)
- Daniel Polyakov
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Be’er Sheva, Israel
- Agricultural, Biological, Cognitive Robotics Initiative, Ben-Gurion University of the Negev, Be’er Sheva, Israel
| | | | - Eli J. Muller
- Brain and Mind Centre, The University of Sydney, Sydney, NSW, Australia
| | - Oren Shriki
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Be’er Sheva, Israel
- Agricultural, Biological, Cognitive Robotics Initiative, Ben-Gurion University of the Negev, Be’er Sheva, Israel
| |
Collapse
|
2
|
Clark KB. Neural Field Continuum Limits and the Structure–Function Partitioning of Cognitive–Emotional Brain Networks. BIOLOGY 2023; 12:biology12030352. [PMID: 36979044 PMCID: PMC10045557 DOI: 10.3390/biology12030352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 01/07/2023] [Accepted: 02/13/2023] [Indexed: 02/25/2023]
Abstract
In The cognitive-emotional brain, Pessoa overlooks continuum effects on nonlinear brain network connectivity by eschewing neural field theories and physiologically derived constructs representative of neuronal plasticity. The absence of this content, which is so very important for understanding the dynamic structure-function embedding and partitioning of brains, diminishes the rich competitive and cooperative nature of neural networks and trivializes Pessoa’s arguments, and similar arguments by other authors, on the phylogenetic and operational significance of an optimally integrated brain filled with variable-strength neural connections. Riemannian neuromanifolds, containing limit-imposing metaplastic Hebbian- and antiHebbian-type control variables, simulate scalable network behavior that is difficult to capture from the simpler graph-theoretic analysis preferred by Pessoa and other neuroscientists. Field theories suggest the partitioning and performance benefits of embedded cognitive-emotional networks that optimally evolve between exotic classical and quantum computational phases, where matrix singularities and condensations produce degenerate structure-function homogeneities unrealistic of healthy brains. Some network partitioning, as opposed to unconstrained embeddedness, is thus required for effective execution of cognitive-emotional network functions and, in our new era of neuroscience, should be considered a critical aspect of proper brain organization and operation.
Collapse
Affiliation(s)
- Kevin B. Clark
- Cures Within Reach, Chicago, IL 60602, USA;
- Felidae Conservation Fund, Mill Valley, CA 94941, USA
- Campus and Domain Champions Program, Multi-Tier Assistance, Training, and Computational Help (MATCH) Track, National Science Foundation’s Advanced Cyberinfrastructure Coordination Ecosystem: Services and Support (ACCESS), https://access-ci.org/
- Expert Network, Penn Center for Innovation, University of Pennsylvania, Philadelphia, PA 19104, USA
- Network for Life Detection (NfoLD), NASA Astrobiology Program, NASA Ames Research Center, Mountain View, CA 94035, USA
- Multi-Omics and Systems Biology & Artificial Intelligence and Machine Learning Analysis Working Groups, NASA GeneLab, NASA Ames Research Center, Mountain View, CA 94035, USA
- Frontier Development Lab, NASA Ames Research Center, Mountain View, CA 94035, USA & SETI Institute, Mountain View, CA 94043, USA
- Peace Innovation Institute, The Hague 2511, Netherlands & Stanford University, Palo Alto, CA 94305, USA
- Shared Interest Group for Natural and Artificial Intelligence (sigNAI), Max Planck Alumni Association, 14057 Berlin, Germany
- Biometrics and Nanotechnology Councils, Institute for Electrical and Electronics Engineers (IEEE), New York, NY 10016, USA
| |
Collapse
|
3
|
Mukta KN, Robinson PA, Pagès JC, Gabay NC, Gao X. Evoked response activity eigenmode analysis in a convoluted cortex via neural field theory. Phys Rev E 2021; 102:062303. [PMID: 33466049 DOI: 10.1103/physreve.102.062303] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Accepted: 07/15/2020] [Indexed: 11/07/2022]
Abstract
Neural field theory of the corticothalamic system is used to explore evoked response potentials (ERPs) caused by spatially localized impulse stimuli on the convoluted cortex and on a spherical cortex. Eigenfunctions are calculated analytically on the spherical cortex and numerically on the convoluted cortex via eigenfunction expansions. Eigenmodes on a convoluted cortex are similar to those of the spherical cortex, and a few such modes are found to be sufficient to reproduce the main ERP features. It is found that the ERP peak is stronger in spherical cortex than convoluted cortex, but in both cases the peak decreases monotonically with increasing distance from the stimulus point. In the convoluted case, cortical folding causes ERPs to differ between locations at the same distance from the stimulus point and spherical symmetries are only approximately preserved.
Collapse
Affiliation(s)
- K N Mukta
- School of Physics, University of Sydney, New South Wales 2006, Australia.,Center for Integrative Brain Function, University of Sydney, New South Wales 2006, Australia
| | - P A Robinson
- School of Physics, University of Sydney, New South Wales 2006, Australia.,Center for Integrative Brain Function, University of Sydney, New South Wales 2006, Australia
| | - J C Pagès
- School of Physics, University of Sydney, New South Wales 2006, Australia.,Center for Integrative Brain Function, University of Sydney, New South Wales 2006, Australia.,School of Physics, University of Zurich, Zürich, Canton of Zürich, Switzerland
| | - N C Gabay
- School of Physics, University of Sydney, New South Wales 2006, Australia.,Center for Integrative Brain Function, University of Sydney, New South Wales 2006, Australia
| | - Xiao Gao
- School of Physics, University of Sydney, New South Wales 2006, Australia.,Center for Integrative Brain Function, University of Sydney, New South Wales 2006, Australia
| |
Collapse
|
4
|
Robinson PA, Gabay NC, Babaie-Janvier T. Neural Field Theory of Evoked Response Sequences and Mismatch Negativity With Adaptation. Front Hum Neurosci 2021; 15:655505. [PMID: 34483860 PMCID: PMC8415526 DOI: 10.3389/fnhum.2021.655505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 07/20/2021] [Indexed: 12/02/2022] Open
Abstract
Physiologically based neural field theory of the corticothalamic system is used to calculate the responses evoked by trains of auditory stimuli that correspond to different cortical locations via the tonotopic map. The results are shown to account for standard and deviant evoked responses to frequent and rare stimuli, respectively, in the auditory oddball paradigms widely used in human cognitive studies, and the so-called mismatch negativity between them. It also reproduces a wide range of other effects and variants, including the mechanism by which a change in standard responses relative to deviants can develop through adaptation, different responses when two deviants are presented in a row or a standard is presented after two deviants, relaxation of standard responses back to deviant form after a stimulus-free period, and more complex sequences. Some cases are identified in which adaptation does not account for the whole difference between standard and deviant responses. The results thus provide a systematic means to determine how much of the response is due to adaptation in the system comprising the primary auditory cortex and medial geniculate nucleus, and how much requires involvement of higher-level processing.
Collapse
Affiliation(s)
- Peter A Robinson
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Natasha C Gabay
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Tara Babaie-Janvier
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
5
|
Robinson PA, Henderson JA, Gabay NC, Aquino KM, Babaie-Janvier T, Gao X. Determination of Dynamic Brain Connectivity via Spectral Analysis. Front Hum Neurosci 2021; 15:655576. [PMID: 34335207 PMCID: PMC8323754 DOI: 10.3389/fnhum.2021.655576] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 06/03/2021] [Indexed: 11/30/2022] Open
Abstract
Spectral analysis based on neural field theory is used to analyze dynamic connectivity via methods based on the physical eigenmodes that are the building blocks of brain dynamics. These approaches integrate over space instead of averaging over time and thereby greatly reduce or remove the temporal averaging effects, windowing artifacts, and noise at fine spatial scales that have bedeviled the analysis of dynamical functional connectivity (FC). The dependences of FC on dynamics at various timescales, and on windowing, are clarified and the results are demonstrated on simple test cases, demonstrating how modes provide directly interpretable insights that can be related to brain structure and function. It is shown that FC is dynamic even when the brain structure and effective connectivity are fixed, and that the observed patterns of FC are dominated by relatively few eigenmodes. Common artifacts introduced by statistical analyses that do not incorporate the physical nature of the brain are discussed and it is shown that these are avoided by spectral analysis using eigenmodes. Unlike most published artificially discretized “resting state networks” and other statistically-derived patterns, eigenmodes overlap, with every mode extending across the whole brain and every region participating in every mode—just like the vibrations that give rise to notes of a musical instrument. Despite this, modes are independent and do not interact in the linear limit. It is argued that for many purposes the intrinsic limitations of covariance-based FC instead favor the alternative of tracking eigenmode coefficients vs. time, which provide a compact representation that is directly related to biophysical brain dynamics.
Collapse
Affiliation(s)
- Peter A Robinson
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - James A Henderson
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Natasha C Gabay
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Kevin M Aquino
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Tara Babaie-Janvier
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Xiao Gao
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia.,Department of Biomedical Engineering, University of Melbourne, Parkville, VIC, Australia
| |
Collapse
|
6
|
Brain dynamics and structure-function relationships via spectral factorization and the transfer function. Neuroimage 2021; 235:117989. [PMID: 33819612 DOI: 10.1016/j.neuroimage.2021.117989] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 02/15/2021] [Accepted: 03/12/2021] [Indexed: 01/07/2023] Open
Abstract
It is shown how the brain's linear transfer function provides a means to systematically analyze brain connectivity and dynamics, and to infer connectivity, eigenmodes, and activity measures such as spectra, evoked responses, coherence, and causality, all of which are widely used in brain monitoring. In particular, the Wilson spectral factorization algorithm is outlined and used to efficiently obtain linear transfer functions from experimental two-point correlation functions. The algorithm is tested on a series of brain-like structures of increasing complexity which include time delays, asymmetry, two-dimensionality, and complex network connectivity. These tests are used to verify the algorithm is suitable for application to brain dynamics, specify sampling requirements for experimental time series, and to verify that its runtime is short enough to obtain accurate results for systems of similar size to current experiments. The results can equally well be applied to inference of the transfer function in complex linear systems other than brains.
Collapse
|
7
|
Griffiths JD, McIntosh AR, Lefebvre J. A Connectome-Based, Corticothalamic Model of State- and Stimulation-Dependent Modulation of Rhythmic Neural Activity and Connectivity. Front Comput Neurosci 2020; 14:575143. [PMID: 33408622 PMCID: PMC7779529 DOI: 10.3389/fncom.2020.575143] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 11/19/2020] [Indexed: 11/13/2022] Open
Abstract
Rhythmic activity in the brain fluctuates with behaviour and cognitive state, through a combination of coexisting and interacting frequencies. At large spatial scales such as those studied in human M/EEG, measured oscillatory dynamics are believed to arise primarily from a combination of cortical (intracolumnar) and corticothalamic rhythmogenic mechanisms. Whilst considerable progress has been made in characterizing these two types of neural circuit separately, relatively little work has been done that attempts to unify them into a single consistent picture. This is the aim of the present paper. We present and examine a whole-brain, connectome-based neural mass model with detailed long-range cortico-cortical connectivity and strong, recurrent corticothalamic circuitry. This system reproduces a variety of known features of human M/EEG recordings, including spectral peaks at canonical frequencies, and functional connectivity structure that is shaped by the underlying anatomical connectivity. Importantly, our model is able to capture state- (e.g., idling/active) dependent fluctuations in oscillatory activity and the coexistence of multiple oscillatory phenomena, as well as frequency-specific modulation of functional connectivity. We find that increasing the level of sensory drive to the thalamus triggers a suppression of the dominant low frequency rhythms generated by corticothalamic loops, and subsequent disinhibition of higher frequency endogenous rhythmic behaviour of intracolumnar microcircuits. These combine to yield simultaneous decreases in lower frequency and increases in higher frequency components of the M/EEG power spectrum during states of high sensory or cognitive drive. Building on this, we also explored the effect of pulsatile brain stimulation on ongoing oscillatory activity, and evaluated the impact of coexistent frequencies and state-dependent fluctuations on the response of cortical networks. Our results provide new insight into the role played by cortical and corticothalamic circuits in shaping intrinsic brain rhythms, and suggest new directions for brain stimulation therapies aimed at state-and frequency-specific control of oscillatory brain activity.
Collapse
Affiliation(s)
- John D. Griffiths
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
| | - Anthony Randal McIntosh
- Rotman Research Institute, Baycrest Health Sciences, Toronto, ON, Canada
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| | - Jeremie Lefebvre
- Department of Biology, University of Ottawa, Ottawa, ON, Canada
- Krembil Research Institute, University Health Network, Toronto, ON, Canada
- Department of Mathematics, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
8
|
Babaie-Janvier T, Robinson PA. Neural Field Theory of Evoked Response Potentials With Attentional Gain Dynamics. Front Hum Neurosci 2020; 14:293. [PMID: 32848668 PMCID: PMC7426978 DOI: 10.3389/fnhum.2020.00293] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Accepted: 06/29/2020] [Indexed: 11/30/2022] Open
Abstract
A generalized neural field model of large-scale activity in the corticothalamic system is used to predict standard evoked potentials. This model embodies local feedbacks that modulate the gains of neural activity as part of the response to incoming stimuli and thus enables both activity changes and effective connectivity changes to be calculated as parts of a generalized evoked response, and their relative contributions to be determined. The results show that incorporation of gain modulations enables a compact and physically justifiable description of the differences in gain between background-EEG and standard-ERP conditions, with the latter able to be initiated from the background state, rather than requiring distinct parameters as in earlier work. In particular, top-down gains are found to be reduced during an ERP, consistent with recent theoretical suggestions that the role of internal models is diminished in favor of external inputs when the latter change suddenly. The static-gain and modulated-gain system transfer functions are analyzed via control theory in terms of system resonances that were recently shown to implement data filtering whose gain adjustments can be interpreted as attention. These filters are shown to govern early and late features in standard evoked responses and their gain parameters are shown to be dynamically adjusted in a way that implements a form of attention. The results show that dynamically modulated resonant filters responsible for the low-frequency oscillations in an evoked potential response have different parameters than those responsible for low-frequency resting EEG responses, while both responses share similar mid- and high-frequency resonant filters. These results provide a biophysical mechanism by which oscillatory activity in the theta, alpha, and beta frequency ranges of an evoked response are modulated as reflections of attention; notably theta is enhanced and alpha suppressed during the latter parts of the ERP. Furthermore, the model enables the part of the ERP response induced by gain modulations to be estimated and interpreted in terms of attention.
Collapse
Affiliation(s)
- Tara Babaie-Janvier
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| | - Peter A Robinson
- School of Physics, University of Sydney, Sydney, NSW, Australia.,Center of Excellence for Integrative Brain Function, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|