1
|
Cortês AB, Duarte JV, Castelo-Branco M. Hysteresis reveals a happiness bias effect in dynamic emotion recognition from ambiguous biological motion. J Vis 2023; 23:5. [PMID: 37962533 PMCID: PMC10653266 DOI: 10.1167/jov.23.13.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Accepted: 10/10/2023] [Indexed: 11/15/2023] Open
Abstract
Considering the nonlinear dynamic nature of emotion recognition, it is believed to be strongly dependent on temporal context. This can be investigated by resorting to the phenomenon of hysteresis, which features a form of serial dependence, entailed by continuous temporal stimulus trajectories. Under positive hysteresis, the percept remains stable in visual memory (persistence) while in negative hysteresis, it shifts earlier (adaptation) to the opposite interpretation. Here, we asked whether positive or negative hysteresis occurs in emotion recognition of inherently ambiguous biological motion, while testing for the controversial debate of a negative versus positive emotional bias. Participants (n = 22) performed a psychophysical experiment in which they were asked to judge stimulus transitions between two emotions, happiness and sadness, from an actor database, and report perceived emotion across time, from one emotion to the opposite as physical cues were continuously changing. Our results reveal perceptual hysteresis in ambiguous emotion recognition, with positive hysteresis (visual persistence) predominating. However, negative hysteresis (adaptation/fatigue) was also observed in particular in the direction from sadness to happiness. This demonstrates a positive (happiness) bias in emotion recognition in ambiguous biological motion recognition. Finally, the interplay between positive and negative hysteresis suggests an underlying competition between visual persistence and adaptation mechanisms during ambiguous emotion recognition.
Collapse
Affiliation(s)
- Ana Borges Cortês
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
| | - João Valente Duarte
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
- Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal
- Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
2
|
Positive hysteresis in emotion recognition: Face processing visual regions are involved in perceptual persistence, which mediates interactions between anterior insula and medial prefrontal cortex. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2022; 22:1275-1289. [PMID: 35857280 PMCID: PMC9622546 DOI: 10.3758/s13415-022-01024-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 06/22/2022] [Indexed: 01/27/2023]
Abstract
Facial emotion perception can be studied from the point of view of dynamic systems whose output may depend not only on current input but also on prior history - a phenomenon known as hysteresis. In cognitive neuroscience, hysteresis has been described as positive (perceptual persistence) or negative (fatigue of current percept) depending on whether perceptual switching occurs later or earlier than actual physical stimulus changes. However, its neural correlates remain elusive. We used dynamic transitions between emotional expressions and combined behavioral assessment with functional magnetic resonance imaging (fMRI) to investigate the underlying circuitry of perceptual hysteresis in facial emotion recognition. Our findings revealed the involvement of face-selective visual areas - fusiform face area (FFA) and superior temporal sulcus (STS) - in perceptual persistence as well as the right anterior insula. Moreover, functional connectivity analyses revealed an interplay between the right anterior insula and medial prefrontal cortex, which showed to be dependent on the presence of positive hysteresis. Our results support the hypothesis that high-order regions are involved in perceptual stabilization and decision during perceptual persistence (positive hysteresis) and add evidence to the role of the anterior insula as a hub of sensory information in perceptual decision-making.
Collapse
|
3
|
Baspinar E, Schülen L, Olmi S, Zakharova A. Coherence resonance in neuronal populations: Mean-field versus network model. Phys Rev E 2021; 103:032308. [PMID: 33862689 DOI: 10.1103/physreve.103.032308] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Accepted: 02/22/2021] [Indexed: 01/17/2023]
Abstract
The counterintuitive phenomenon of coherence resonance describes a nonmonotonic behavior of the regularity of noise-induced oscillations in the excitable regime, leading to an optimal response in terms of regularity of the excited oscillations for an intermediate noise intensity. We study this phenomenon in populations of FitzHugh-Nagumo (FHN) neurons with different coupling architectures. For networks of FHN systems in an excitable regime, coherence resonance has been previously analyzed numerically. Here we focus on an analytical approach studying the mean-field limits of the globally and locally coupled populations. The mean-field limit refers to an averaged behavior of a complex network as the number of elements goes to infinity. We apply the mean-field approach to the globally coupled FHN network. Further, we derive a mean-field limit approximating the locally coupled FHN network with low noise intensities. We study the effects of the coupling strength and noise intensity on coherence resonance for both the network and the mean-field models. We compare the results of the mean-field and network frameworks and find good agreement in the globally coupled case, where the correspondence between the two approaches is sufficiently good to capture the emergence of coherence resonance, as well as of anticoherence resonance.
Collapse
Affiliation(s)
- Emre Baspinar
- Inria Sophia Antipolis Méditerranée Research Centre, 2004 Route des Lucioles, 06902 Valbonne, France
| | - Leonhard Schülen
- Institut für Theoretische Physik, Technische Universität Berlin, Hardenbergstraße 36, 10623 Berlin, Germany
| | - Simona Olmi
- Inria Sophia Antipolis Méditerranée Research Centre, 2004 Route des Lucioles, 06902 Valbonne, France.,CNR - Consiglio Nazionale delle Ricerche - Istituto dei Sistemi complessi, 50019, Sesto Fiorentino, Italy.,Joint Senior Authorship
| | - Anna Zakharova
- Institut für Theoretische Physik, Technische Universität Berlin, Hardenbergstraße 36, 10623 Berlin, Germany.,Joint Senior Authorship
| |
Collapse
|
4
|
Dynamics of a Mutual Inhibition Circuit between Pyramidal Neurons Compared to Human Perceptual Competition. J Neurosci 2021; 41:1251-1264. [PMID: 33443089 DOI: 10.1523/jneurosci.2503-20.2020] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 11/16/2020] [Accepted: 12/09/2020] [Indexed: 11/21/2022] Open
Abstract
Neural competition plays an essential role in active selection processes of noisy and ambiguous input signals, and it is assumed to underlie emergent properties of brain functioning, such as perceptual organization and decision-making. Despite ample theoretical research on neural competition, experimental tools to allow neurophysiological investigation of competing neurons have not been available. We developed a "hybrid" system where real-life neurons and a computer-simulated neural circuit interacted. It enabled us to construct a mutual inhibition circuit between two real-life pyramidal neurons. We then asked what dynamics this minimal unit of neural competition exhibits and compared them with the known behavioral-level dynamics of neural competition. We found that the pair of neurons shows bistability when activated simultaneously by current injections. The addition of modeled synaptic noise and changes in the activation strength showed that the dynamics of the circuit are strikingly similar to the known properties of bistable visual perception: The distribution of dominance durations showed a right-skewed shape, and the changes of the activation strengths caused changes in dominance, dominance durations, and reversal rates as stated in the well-known empirical laws of bistable perception known as Levelt's propositions.SIGNIFICANCE STATEMENT Visual perception emerges as the result of neural systems actively organizing visual signals that involves selection processes of competing neurons. While the neural competition, realized by a "mutual inhibition" circuit has been examined in many theoretical studies, its properties have not been investigated in real neurons. We have developed a "hybrid" system where two real-life pyramidal neurons in a mouse brain slice interact through a computer-simulated mutual inhibition circuit. We found that simultaneous activation of the neurons leads to bistable activity. We investigated the effect of noise and the effect of changes in the activation strength on the dynamics. We observed that the pair of neurons exhibit dynamics strikingly similar to the known properties of bistable visual perception.
Collapse
|
5
|
Pavithran I, Sujith RI. Effect of rate of change of parameter on early warning signals for critical transitions. CHAOS (WOODBURY, N.Y.) 2021; 31:013116. [PMID: 33754769 DOI: 10.1063/5.0025533] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2020] [Accepted: 12/09/2020] [Indexed: 06/12/2023]
Abstract
Many dynamical systems exhibit abrupt transitions or tipping as the control parameter is varied. In scenarios where the parameter is varied continuously, the rate of change of the control parameter greatly affects the performance of early warning signals (EWS) for such critical transitions. We study the impact of variation of the control parameter with a finite rate on the performance of EWS for critical transitions in a thermoacoustic system (a horizontal Rijke tube) exhibiting subcritical Hopf bifurcation. There is a growing interest in developing early warning signals for tipping in real systems. First, we explore the efficacy of early warning signals based on critical slowing down and fractal characteristics. From this study, lag-1 autocorrelation (AC) and Hurst exponent (H) are found to be good measures to predict the transition well before the tipping point. The warning time, obtained using AC and H, reduces with an increase in the rate of change of the control parameter following an inverse power law relation. Hence, for very fast rates, the warning time may be too short to perform any control action. Furthermore, we report the observation of a hyperexponential scaling relation between the AC and the variance of fluctuations during such a dynamic Hopf bifurcation. We construct a theoretical model for noisy Hopf bifurcation wherein the control parameter is continuously varied at different rates to study the effect of rate of change of the parameter on EWS. Similar results, including the hyperexponential scaling, are observed in the model as well.
Collapse
Affiliation(s)
| | - R I Sujith
- Department of Aerospace Engineering, IIT Madras, Chennai 600036, India
| |
Collapse
|
6
|
Chholak P, Maksimenko VA, Hramov AE, Pisarchik AN. Voluntary and Involuntary Attention in Bistable Visual Perception: A MEG Study. Front Hum Neurosci 2020; 14:597895. [PMID: 33414711 PMCID: PMC7782248 DOI: 10.3389/fnhum.2020.597895] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Accepted: 11/20/2020] [Indexed: 11/13/2022] Open
Abstract
In this study, voluntary and involuntary visual attention focused on different interpretations of a bistable image, were investigated using magnetoencephalography (MEG). A Necker cube with sinusoidally modulated pixels' intensity in the front and rear faces with frequencies 6.67 Hz (60/9) and 8.57 Hz (60/7), respectively, was presented to 12 healthy volunteers, who interpreted the cube as either left- or right-oriented. The tags of these frequencies and their second harmonics were identified in the average Fourier spectra of the MEG data recorded from the visual cortex. In the first part of the experiment, the subjects were asked to voluntarily control their attention by interpreting the cube orientation as either being on the left or right. Accordingly, we observed the dominance of the corresponding spectral component, and voluntary attention performance was measured. In the second part of the experiment, the subjects were asked to focus their gaze on a red marker at the center of the cube image without putting forth effort in its interpretation. The alternation of the dominant spectral energies at the second harmonics of the stimulation frequencies was treated as changes in the cube orientation. Based on the results of the first experimental stage and using a wavelet analysis, we developed a method which allowed us to identify the currently perceived cube orientation. Finally, we characterized involuntary attention using the distribution of dominance times when focusing attention on one of the cube orientations, which was related to voluntary attention performance and brain noise. In particular, we confirmed our hypothesis that higher attention performance is associated with stronger brain noise.
Collapse
Affiliation(s)
- Parth Chholak
- Center for Biomedical Technology, Technical University of Madrid, Pozuelo de Alarcón, Madrid, Spain
| | - Vladimir A. Maksimenko
- Laboratory of Neuroscience and Cognitive Technology, Center for Technologies in Robotics and Mechatronics Component, Innolpolis University, Innopolis, Russia
| | - Alexander E. Hramov
- Laboratory of Neuroscience and Cognitive Technology, Center for Technologies in Robotics and Mechatronics Component, Innolpolis University, Innopolis, Russia
- Department of Automation, Control and Mechatronics, Saratov State Medical University, Saratov, Russia
| | - Alexander N. Pisarchik
- Center for Biomedical Technology, Technical University of Madrid, Pozuelo de Alarcón, Madrid, Spain
- Laboratory of Neuroscience and Cognitive Technology, Center for Technologies in Robotics and Mechatronics Component, Innolpolis University, Innopolis, Russia
| |
Collapse
|
7
|
Identification of competing neural mechanisms underlying positive and negative perceptual hysteresis in the human visual system. Neuroimage 2020; 221:117153. [PMID: 32659351 DOI: 10.1016/j.neuroimage.2020.117153] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 07/02/2020] [Accepted: 07/06/2020] [Indexed: 11/22/2022] Open
Abstract
Hysteresis is a well-known phenomenon in physics that relates changes in a system with its prior history. It is also part of human visual experience (perceptual hysteresis), and two different neural mechanisms might explain it: persistence (a cause of positive hysteresis), which forces to keep a current percept for longer, and adaptation (a cause of negative hysteresis), which in turn favors the switch to a competing percept early on. In this study, we explore the neural correlates underlying these mechanisms and the hypothesis of their competitive balance, by combining behavioral assessment with fMRI. We used machine learning on the behavioral data to distinguish between positive and negative hysteresis, and discovered a neural correlate of persistence at a core region of the ventral attention network, the anterior insula. Our results add to the understanding of perceptual multistability and reveal a possible mechanistic explanation for the regulation of different forms of perceptual hysteresis.
Collapse
|
8
|
Yamakou ME, Hjorth PG, Martens EA. Optimal Self-Induced Stochastic Resonance in Multiplex Neural Networks: Electrical vs. Chemical Synapses. Front Comput Neurosci 2020; 14:62. [PMID: 32848683 PMCID: PMC7427607 DOI: 10.3389/fncom.2020.00062] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Accepted: 05/28/2020] [Indexed: 01/23/2023] Open
Abstract
Electrical and chemical synapses shape the dynamics of neural networks, and their functional roles in information processing have been a longstanding question in neurobiology. In this paper, we investigate the role of synapses on the optimization of the phenomenon of self-induced stochastic resonance in a delayed multiplex neural network by using analytical and numerical methods. We consider a two-layer multiplex network in which, at the intra-layer level, neurons are coupled either by electrical synapses or by inhibitory chemical synapses. For each isolated layer, computations indicate that weaker electrical and chemical synaptic couplings are better optimizers of self-induced stochastic resonance. In addition, regardless of the synaptic strengths, shorter electrical synaptic delays are found to be better optimizers of the phenomenon than shorter chemical synaptic delays, while longer chemical synaptic delays are better optimizers than longer electrical synaptic delays; in both cases, the poorer optimizers are, in fact, worst. It is found that electrical, inhibitory, or excitatory chemical multiplexing of the two layers having only electrical synapses at the intra-layer levels can each optimize the phenomenon. Additionally, only excitatory chemical multiplexing of the two layers having only inhibitory chemical synapses at the intra-layer levels can optimize the phenomenon. These results may guide experiments aimed at establishing or confirming to the mechanism of self-induced stochastic resonance in networks of artificial neural circuits as well as in real biological neural networks.
Collapse
Affiliation(s)
- Marius E. Yamakou
- Max-Planck-Institut für Mathematik in den Naturwissenschaften, Leipzig, Germany
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark
| | - Poul G. Hjorth
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark
| | - Erik A. Martens
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark
- Department of Biomedical Science, University of Copenhagen, Copenhagen, Denmark
- Centre for Translational Neuromedicine, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
9
|
Verdade A, Castelhano J, Sousa T, Castelo-Branco M. How positive emotional content overrules perceptual history effects: Hysteresis in emotion recognition. J Vis 2020; 20:19. [PMID: 32805042 PMCID: PMC7438663 DOI: 10.1167/jov.20.8.19] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The human visual system is constantly processing multiple and often conflicting sensory cues to make perceptual decisions. Given the nonlinear nature of emotion recognition, this often leads to different percepts of the same physical facial expression. Moreover, the state of the emotion recognition system might depend on the trajectory of temporal context, potentially leading to a phenomenon known as perceptual hysteresis. Here, we aimed to explore temporal context-related mechanisms underlying perceptual hysteresis during emotion recognition. We hypothesized that dependence on recent perceptual experience might reveal important clues about the role of short-term memory on the perception of emotional stimuli. Behavioral data were acquired using reality-based, changing emotion expressions morphed from a source to a target emotion with different valences, always passing through a neutral expression. Participants identified the onset and offset of what they perceived as the neutral expression interval. Our results showed that current perception of emotional expression is affected by recent temporal context, thus revealing perceptual hysteresis. We also found a relation between recent perceptual history effects and stimulus emotional Content: The positive valence of the stimulus emotional content appeared to abolish perceptual history effects, whereas negatively loaded stimuli induced clear short-term memory effects and positive hysteresis. Our findings show direct competition between recent perceptual experience and stimulus emotional content during decision making, which affects the formation of current percepts in emotion recognition.
Collapse
Affiliation(s)
- Andreia Verdade
- Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Coimbra, Portugal.,Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal.,Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| | - João Castelhano
- Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Coimbra, Portugal.,Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal.,Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| | - Teresa Sousa
- Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Coimbra, Portugal.,Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal.,Faculty of Medicine, University of Coimbra, Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Coimbra, Portugal.,Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Coimbra, Portugal.,Faculty of Medicine, University of Coimbra, Coimbra, Portugal.,ICNAS - Produção, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
10
|
A neural network model for exogenous perceptual alternations of the Necker cube. Cogn Neurodyn 2019; 14:229-237. [PMID: 32226564 DOI: 10.1007/s11571-019-09565-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2019] [Revised: 09/20/2019] [Accepted: 11/22/2019] [Indexed: 10/25/2022] Open
Abstract
When a bistable visual image, such as the Necker cube, is continuously viewed, the percept of the image endogenously alternates between one possible percept and the other. However, perceptual alternation can also be induced by an exogenous perturbation. For example, a typical external perturbation is the flashlight, which is expected to pervasively activate many brain regions. Therefore, the neural mechanism related to exogenous perceptual alternation remains to be clarified. As a cue to solving this problem, our recent psychophysiological experiment reported a positive correlation between the enhancement of visual mismatch negativity evoked by breaks in the sequential regularity of the visual stimuli and the proportion of perceptual alternation. To elucidate the mechanism underlying exogenous perceptual alternation induced by visual mismatch negativity, the present study attempted to construct a neural network model for bistable perception of the Necker cube, whose perceptual alternation is facilitated by an increase in visual mismatch negativity. The model consists of both a prediction layer and a prediction error layer, following the predictive coding framework for biologically plausible relationships between the change detection process and the perceptual alternation mechanism. Computer simulations showed that the mean duration of perception decreased as the response increased, which is in concordance with the experimental data. This result suggested that the excitatory feedforward and inhibitory feedback connections play an important role. Additionally, the validity of this model suggests that the visual mismatch signal propagates in the neural systems and affects the visual perceptual mechanism as a prediction error signal.
Collapse
|
11
|
Bistable perception of ambiguous images: simple Arrhenius model. Cogn Neurodyn 2019; 13:613-621. [PMID: 31741696 DOI: 10.1007/s11571-019-09554-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Revised: 08/09/2019] [Accepted: 08/28/2019] [Indexed: 10/26/2022] Open
Abstract
Watching an ambiguous image leads to the bistability of its perception, that randomly oscillates between two possible interpretations. The relevant evolution of the neuron system is usually described with the equation of its "movement" over the nonuniform energy landscape under the action of the stochastic force, corresponding to noise perturbations. We utilize the alternative (and simpler) approach suggesting that the system is in the quasi-stationary state being described by the Arrhenius equation. The latter, in fact, determines the probability of the dynamical variation of the image being percepted (for example, the left Necker cube ↔ the right Necker cube) along one scenario or another. Probabilities of transitions from one perception to another are defined by barriers detaching corresponding wells of the energy landscape, and the relative value of the noise (analog of temperature) influencing this process. The mean noise value could be estimated from experimental data. The model predicts logarithmic dependence of the perception hysteresis width on the period of cyclic sweeping the parameter, controlling the perception (for instance, the contrast of the presented object). It agrees with the experiment and allows to estimate the time interval between two various perceptions.
Collapse
|
12
|
Embodied gestalts: Unstable visual phenomena become stable when they are stimuli for competitive action selection. Atten Percept Psychophys 2019; 81:2330-2342. [PMID: 31650520 DOI: 10.3758/s13414-019-01868-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
An animal's environment is rich with affordances. Different possible actions are specified by visual information while competing for dominance over neural dynamics. Affordance competition models account for this in terms of winner-takes-all cross-inhibition dynamics. Multistable phenomena also reveal how the visual system deals with ambiguity. Their key property is spontaneous instability, in forms such as alternating dominance in binocular rivalry. Theoretical models of self-inhibition or self-organized instability posit that the instability is tied to some kind of neural adaptation and that its functional significance is to enable flexible perceptual transitions. We hypothesized that the two perspectives are interlinked. Spontaneous instability is an intrinsic property of perceptual systems, but it is revealed when they are stripped from the constraints of possibilities for action. To test this, we compared a multistable gestalt phenomenon against its embodied version and estimated the neural adaptation and competition parameters of an affordance transition dynamic model. Wertheimer's (Zeitschrift fur Psychologie 61, 161-265, 1912) optimal (β) and pure (φ) forms of apparent motion from a stroboscopic point-light display were endowed with action relevance by embedding the display in a visual object-tracking task. Thus, each mode was complemented by its action, because each perceptual mode uniquely enabled different ways of tracking the target. Perceptual judgment of the traditional apparent motion exhibited spontaneous instabilities, in the form of earlier switching when the frame rate was changed stepwise. In contrast, the embodied version exhibited hysteresis, consistent with affordance transition studies. Consistent with our predictions, the parameter for competition between modes in the affordance transition model increased, and the parameter for self-inhibition vanished.
Collapse
|
13
|
Hramov AE, Maksimenko V, Koronovskii A, Runnova AE, Zhuravlev M, Pisarchik AN, Kurths J. Percept-related EEG classification using machine learning approach and features of functional brain connectivity. CHAOS (WOODBURY, N.Y.) 2019; 29:093110. [PMID: 31575147 DOI: 10.1063/1.5113844] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2019] [Accepted: 08/08/2019] [Indexed: 06/10/2023]
Abstract
Machine learning is a promising approach for electroencephalographic (EEG) trials classification. Its efficiency is largely determined by the feature extraction and selection techniques reducing the dimensionality of input data. Dimensionality reduction is usually implemented via the mathematical approaches (e.g., principal component analysis, linear discriminant analysis, etc.) regardless of the origin of analyzed data. We hypothesize that since EEG features are determined by certain neurophysiological processes, they should have distinctive characteristics in spatiotemporal domain. If so, it is possible to specify the set of EEG principal features based on the prior knowledge about underlying neurophysiological processes. To test this hypothesis, we consider the classification of EEG trials related to the perception of ambiguous visual stimuli. We observe that EEG features, underlying the different ambiguous stimuli interpretations, are defined by the network properties of neuronal activity. Having analyzed functional neural interactions, we specify the brain area in which neural network architecture exhibits differences for different classes of EEG trials. We optimize the feedforward multilayer perceptron and develop a strategy for the training set selection to maximize the classification accuracy, being 85% when all channels are used. The revealed localization of the percept-related features allows about 95% accuracy, when the number of channels is reduced up to 90%. Obtained results can be used for classification of EEG trials associated with more complex cognitive tasks. Taking into account that cognitive activity is subserved by a distributed functional cortical network, its topological properties have to be considered when selecting optimal features for EEG trial classification.
Collapse
Affiliation(s)
- Alexander E Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Vladimir Maksimenko
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Alexey Koronovskii
- Faculty of Nonlinear Processes, Saratov State University, 410012 Saratov, Russia
| | - Anastasiya E Runnova
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Maxim Zhuravlev
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Alexander N Pisarchik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, 14473 Potsdam, Germany
| |
Collapse
|
14
|
Yamakou ME, Jost J. Control of coherence resonance by self-induced stochastic resonance in a multiplex neural network. Phys Rev E 2019; 100:022313. [PMID: 31574701 DOI: 10.1103/physreve.100.022313] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2019] [Indexed: 06/10/2023]
Abstract
We consider a two-layer multiplex network of diffusively coupled FitzHugh-Nagumo (FHN) neurons in the excitable regime. We show that the phenomenon of coherence resonance (CR) in one layer can not only be controlled by the network topology, the intra- and interlayer time-delayed couplings, but also by another phenomenon, namely, self-induced stochastic resonance (SISR) in the other layer. Numerical computations show that when the layers are isolated, each of these noise-induced phenomena is weakened (strengthened) by a sparser (denser) ring network topology, stronger (weaker) intralayer coupling forces, and longer (shorter) intralayer time delays. However, CR shows a much higher sensitivity than SISR to changes in these control parameters. It is also shown, in contrast to SISR in a single isolated FHN neuron, that the maximum noise amplitude at which SISR occurs in the network of coupled FHN neurons is controllable, especially in the regime of strong coupling forces and long time delays. In order to use SISR in the first layer of the multiplex network to control CR in the second layer, we first choose the control parameters of the second layer in isolation such that in one case CR is poor and in another case, nonexistent. It is then shown that a pronounced SISR can not only significantly improve a poor CR, but can also induce a pronounced CR, which was nonexistent in the isolated second layer. In contrast to strong intralayer coupling forces, strong interlayer coupling forces are found to enhance CR, while long interlayer time delays, just as long intralayer time delays, deteriorate CR. Most importantly, we find that in a strong interlayer coupling regime, SISR in the first layer performs better than CR in enhancing CR in the second layer. But in a weak interlayer coupling regime, CR in the first layer performs better than SISR in enhancing CR in the second layer. Our results could find novel applications in noisy neural network dynamics and engineering.
Collapse
Affiliation(s)
- Marius E Yamakou
- Max-Planck-Institut für Mathematik in den Naturwissenschaften, Inselstraße 22, 04103 Leipzig, Germany
| | - Jürgen Jost
- Max-Planck-Institut für Mathematik in den Naturwissenschaften, Inselstraße 22, 04103 Leipzig, Germany
- Santa Fe Institute for the Sciences of Complexity, Santa Fe, New Mexico 87501, USA
| |
Collapse
|
15
|
Andreev AV, Frolov NS, Pisarchik AN, Hramov AE. Chimera state in complex networks of bistable Hodgkin-Huxley neurons. Phys Rev E 2019; 100:022224. [PMID: 31574636 DOI: 10.1103/physreve.100.022224] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2019] [Indexed: 06/10/2023]
Abstract
In this paper we study a chimera state in complex networks of bistable Hodgkin-Huxley neurons with excitatory coupling, which manifests as a termination of spiking activity of a part of interacting neurons. We provide a detailed investigation of this phenomenon in scale-free, small-world, and random networks and show that the chimera state is robust to the network topology. Nevertheless, network topological properties determine the stability of spatiotemporal states and therefore affect the excitability of the chimera state in the whole network. In particular, the scale-free network whose higher degree nodes are more stable to small perturbations is least exposed to chimera formation and exhibits an abrupt transition from a spiking to a silent regime. On the other hand, small-world and random networks are more likely to provide transitions to the chimera state.
Collapse
Affiliation(s)
- A V Andreev
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya, 1, Innopolis, Republic of Tatarstan, 420500, Russia
| | - N S Frolov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya, 1, Innopolis, Republic of Tatarstan, 420500, Russia
| | - A N Pisarchik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya, 1, Innopolis, Republic of Tatarstan, 420500, Russia
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, 28223 Madrid, Spain
| | - A E Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya, 1, Innopolis, Republic of Tatarstan, 420500, Russia
- Saratov State Medical University, Bolshaya Kazachia st., 112, Saratov, 410012, Russia
| |
Collapse
|
16
|
Unni VR, Gopalakrishnan EA, Syamkumar KS, Sujith RI, Surovyatkina E, Kurths J. Interplay between random fluctuations and rate dependent phenomena at slow passage to limit-cycle oscillations in a bistable thermoacoustic system. CHAOS (WOODBURY, N.Y.) 2019; 29:031102. [PMID: 30927835 DOI: 10.1063/1.5088943] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2019] [Accepted: 03/11/2019] [Indexed: 06/09/2023]
Abstract
We study the impact of noise on the rate dependent transitions in a noisy bistable oscillator using a thermoacoustic system as an example. As the parameter-the heater power-is increased in a quasi-steady manner, beyond a critical value, the thermoacoustic system undergoes a subcritical Hopf bifurcation and exhibits periodic oscillations. We observe that the transition to this oscillatory state is often delayed when the control parameter is varied as a function of time. However, the presence of inherent noise in the system introduces high variability in the characteristics of this critical transition. As a result, if the value of the system variable-the acoustic pressure-approaches the noise floor before the system crosses the unstable manifold, the effect of rate on the critical transition becomes irrelevant in determining the transition characteristics, and the system undergoes a noise-induced tipping to limit-cycle oscillations. The presence of noise-induced tipping makes it difficult to identify the stability regimes in such systems by using stability maps for the corresponding deterministic system.
Collapse
Affiliation(s)
- Vishnu R Unni
- Department of Mechanical and Aerospace Engineering, University of California San Diego, San Diego, California 92093, USA
| | - E A Gopalakrishnan
- Center for Computational Engineering and Networking, Amrita School of Engineering, Coimbatore 641112, India
| | - K S Syamkumar
- Indian Institute of Technology Madras, Chennai 600036, India
| | - R I Sujith
- Indian Institute of Technology Madras, Chennai 600036, India
| | | | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, Berlin 14412, Germany
| |
Collapse
|
17
|
Maksimenko VA, Hramov AE, Frolov NS, Lüttjohann A, Nedaivozov VO, Grubov VV, Runnova AE, Makarov VV, Kurths J, Pisarchik AN. Increasing Human Performance by Sharing Cognitive Load Using Brain-to-Brain Interface. Front Neurosci 2018; 12:949. [PMID: 30631262 PMCID: PMC6315120 DOI: 10.3389/fnins.2018.00949] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Accepted: 11/29/2018] [Indexed: 11/13/2022] Open
Abstract
Brain-computer interfaces (BCIs) attract a lot of attention because of their ability to improve the brain's efficiency in performing complex tasks using a computer. Furthermore, BCIs can increase human's performance not only due to human-machine interactions, but also thanks to an optimal distribution of cognitive load among all members of a group working on a common task, i.e., due to human-human interaction. The latter is of particular importance when sustained attention and alertness are required. In every day practice, this is a common occurrence, for example, among office workers, pilots of a military or a civil aircraft, power plant operators, etc. Their routinely work includes continuous monitoring of instrument readings and implies a heavy cognitive load due to processing large amounts of visual information. In this paper, we propose a brain-to-brain interface (BBI) which estimates brain states of every participant and distributes a cognitive load among all members of the group accomplishing together a common task. The BBI allows sharing the whole workload between all participants depending on their current cognitive performance estimated from their electrical brain activity. We show that the team efficiency can be increased due to redistribution of the work between participants so that the most difficult workload falls on the operator who exhibits maximum performance. Finally, we demonstrate that the human-to-human interaction is more efficient in the presence of a certain delay determined by brain rhythms. The obtained results are promising for the development of a new generation of communication systems based on neurophysiological brain activity of interacting people. Such BBIs will distribute a common task between all group members according to their individual physical conditions.
Collapse
Affiliation(s)
- Vladimir A Maksimenko
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Alexander E Hramov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Nikita S Frolov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | | | - Vladimir O Nedaivozov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vadim V Grubov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Anastasia E Runnova
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vladimir V Makarov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, Potsdam, Germany.,Department of Physics, Humboldt University, Berlin, Germany.,Institute for Complex Systems and Mathematical Biology, University of Aberdeen, Aberdeen, United Kingdom
| | - Alexander N Pisarchik
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Center for Biomedical Technology, Technical University of Madrid, Madrid, Spain
| |
Collapse
|
18
|
Maksimenko VA, Runnova AE, Frolov NS, Makarov VV, Nedaivozov V, Koronovskii AA, Pisarchik A, Hramov AE. Multiscale neural connectivity during human sensory processing in the brain. Phys Rev E 2018; 97:052405. [PMID: 29906840 DOI: 10.1103/physreve.97.052405] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2018] [Indexed: 11/07/2022]
Abstract
Stimulus-related brain activity is considered using wavelet-based analysis of neural interactions between occipital and parietal brain areas in alpha (8-12 Hz) and beta (15-30 Hz) frequency bands. We show that human sensory processing related to the visual stimuli perception induces brain response resulted in different ways of parieto-occipital interactions in these bands. In the alpha frequency band the parieto-occipital neuronal network is characterized by homogeneous increase of the interaction between all interconnected areas both within occipital and parietal lobes and between them. In the beta frequency band the occipital lobe starts to play a leading role in the dynamics of the occipital-parietal network: The perception of visual stimuli excites the visual center in the occipital area and then, due to the increase of parieto-occipital interactions, such excitation is transferred to the parietal area, where the attentional center takes place. In the case when stimuli are characterized by a high degree of ambiguity, we find greater increase of the interaction between interconnected areas in the parietal lobe due to the increase of human attention. Based on revealed mechanisms, we describe the complex response of the parieto-occipital brain neuronal network during the perception and primary processing of the visual stimuli. The results can serve as an essential complement to the existing theory of neural aspects of visual stimuli processing.
Collapse
Affiliation(s)
- Vladimir A Maksimenko
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia
| | - Anastasia E Runnova
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia
| | - Nikita S Frolov
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia
| | - Vladimir V Makarov
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia
| | - Vladimir Nedaivozov
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia
| | - Alexey A Koronovskii
- Saratov State University, Faculty of Nonlinear Processes, Saratov, 410012, Russia
| | - Alexander Pisarchik
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia.,Technical University of Madrid, Campus Montegancedo, E-Madrid 28223, Spain
| | - Alexander E Hramov
- Yuri Gagarin State Technical University of Saratov, REC "Artificial Intelligence Systems and Neurotechnologies", Saratov, 410054, Russia.,Saratov State University, Faculty of Nonlinear Processes, Saratov, 410012, Russia
| |
Collapse
|
19
|
Liaci E, Fischer A, Atmanspacher H, Heinrichs M, Tebartz van Elst L, Kornmeier J. Positive and negative hysteresis effects for the perception of geometric and emotional ambiguities. PLoS One 2018; 13:e0202398. [PMID: 30256789 PMCID: PMC6157843 DOI: 10.1371/journal.pone.0202398] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2017] [Accepted: 08/02/2018] [Indexed: 12/21/2022] Open
Abstract
AIM The present study utilizes perceptual hysteresis effects to compare the ambiguity of Mona Lisa's emotional face expression (high-level ambiguity) and of geometric cube stimuli (low-level ambiguity). METHODS In two experiments we presented series of nine Mona Lisa variants and nine cube variants. Stimulus ambiguity was manipulated by changing Mona Lisa's mouth curvature (Exp. 1) and the cubes' back-layer luminance (Exp. 2). Each experiment consisted of three conditions, two with opposite stimulus presentation sequences with increasing and decreasing degrees of ambiguity, respectively, and a third condition with a random presentation sequence. Participants indicated happy or sad face percepts (Exp. 1) and alternative 3D cube percepts (Exp. 2) by key presses. We studied the influences of a priori perceptual biases (long-term memory) and presentation order (short-term memory) on perception. RESULTS Perception followed sigmoidal functions of the stimulus ambiguity morphing parameters. The morphing parameter for the functions' inflection points depended strongly on stimulus presentation order with similar effect sizes but different signs for the two stimulus types (positive hysteresis / priming for the cubes; negative hysteresis / adaptation for Mona Lisa). In the random conditions, the inflection points were located in the middle between those from the two directional conditions for the Mona Lisa stimuli. For the cube stimuli, they were superimposed on one sigmoidal function for the ordered condition. DISCUSSION The hysteresis effects reflect the influence of short-term memory during the perceptual disambiguation of ambiguous sensory information. The effects for the two stimulus types are of similar size, explaining up to 34% of the perceptual variance introduced by the paradigm. We explain the qualitative difference between positive and negative hysteresis with adaptation for Mona Lisa and with priming for the cubes. In addition, the hysteresis paradigm allows a quantitative determination of the impact of adaptation and priming during the resolution of perceptual ambiguities. The asymmetric shifts of inflection points in the case of the cube stimuli is likely due to an a priori perceptual bias, reflecting an influence of long-term memory. Whether corresponding influences also exist for the Mona Lisa variants is so far unclear.
Collapse
Affiliation(s)
- Emanuela Liaci
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Section for Experimental Neuropsychiatry, Department for Psychiatry & Psychotherapy, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Department of Psychology, University of Freiburg, Freiburg, Germany
| | - Andreas Fischer
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
| | - Harald Atmanspacher
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Collegium Helveticum, Zürich, Switzerland
| | - Markus Heinrichs
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Department of Psychology, University of Freiburg, Freiburg, Germany
| | - Ludger Tebartz van Elst
- Section for Experimental Neuropsychiatry, Department for Psychiatry & Psychotherapy, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Jürgen Kornmeier
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Section for Experimental Neuropsychiatry, Department for Psychiatry & Psychotherapy, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| |
Collapse
|
20
|
Pisarchik AN, Bashkirtseva IA, Ryashko LB. Strange periodic attractor: Extremely high stochastic sensitivity of a parametrically modulated system. ACTA ACUST UNITED AC 2018. [DOI: 10.1209/0295-5075/123/40001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
21
|
Semenova N, Zakharova A. Weak multiplexing induces coherence resonance. CHAOS (WOODBURY, N.Y.) 2018; 28:051104. [PMID: 29857656 DOI: 10.1063/1.5037584] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Using the model of a FitzHugh-Nagumo system in the excitable regime, we study the impact of multiplexing on coherence resonance in a two-layer network. We show that multiplexing allows for the control of the noise-induced dynamics. In particular, we find that multiplexing induces coherence resonance in networks that do not demonstrate this phenomenon in isolation. Examples are provided by deterministic networks and networks where the strength of interaction between the elements is not optimal for coherence resonance. In both cases, we show that the control strategy based on multiplexing can be successfully applied even for weak coupling between the layers. Moreover, for the case of deterministic networks, we obtain a counter-intuitive result: the multiplex-induced coherence resonance in the layer which is deterministic in isolation manifests itself even more strongly than that in the noisy layer.
Collapse
Affiliation(s)
- Nadezhda Semenova
- Department of Physics, Saratov State University, Astrakhanskaya Str. 83, 410012 Saratov, Russia
| | - Anna Zakharova
- Institut für Theoretische Physik, Technische Universität Berlin, Hardenbergstr. 36, 10623 Berlin, Germany
| |
Collapse
|
22
|
Hramov AE, Frolov NS, Maksimenko VA, Makarov VV, Koronovskii AA, Garcia-Prieto J, Antón-Toro LF, Maestú F, Pisarchik AN. Artificial neural network detects human uncertainty. CHAOS (WOODBURY, N.Y.) 2018; 28:033607. [PMID: 29604631 DOI: 10.1063/1.5002892] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Artificial neural networks (ANNs) are known to be a powerful tool for data analysis. They are used in social science, robotics, and neurophysiology for solving tasks of classification, forecasting, pattern recognition, etc. In neuroscience, ANNs allow the recognition of specific forms of brain activity from multichannel EEG or MEG data. This makes the ANN an efficient computational core for brain-machine systems. However, despite significant achievements of artificial intelligence in recognition and classification of well-reproducible patterns of neural activity, the use of ANNs for recognition and classification of patterns in neural networks still requires additional attention, especially in ambiguous situations. According to this, in this research, we demonstrate the efficiency of application of the ANN for classification of human MEG trials corresponding to the perception of bistable visual stimuli with different degrees of ambiguity. We show that along with classification of brain states associated with multistable image interpretations, in the case of significant ambiguity, the ANN can detect an uncertain state when the observer doubts about the image interpretation. With the obtained results, we describe the possible application of ANNs for detection of bistable brain activity associated with difficulties in the decision-making process.
Collapse
Affiliation(s)
- Alexander E Hramov
- Artificial Intelligence Systems and Neurotechnologies, Yuri Gagarin State Technical University of Saratov, Politehnicheskaya, 77, Saratov 410054, Russia
| | - Nikita S Frolov
- Artificial Intelligence Systems and Neurotechnologies, Yuri Gagarin State Technical University of Saratov, Politehnicheskaya, 77, Saratov 410054, Russia
| | - Vladimir A Maksimenko
- Artificial Intelligence Systems and Neurotechnologies, Yuri Gagarin State Technical University of Saratov, Politehnicheskaya, 77, Saratov 410054, Russia
| | - Vladimir V Makarov
- Artificial Intelligence Systems and Neurotechnologies, Yuri Gagarin State Technical University of Saratov, Politehnicheskaya, 77, Saratov 410054, Russia
| | | | - Juan Garcia-Prieto
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, 28223 Pozuelo de Alarcon, Madrid, Spain
| | - Luis Fernando Antón-Toro
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, 28223 Pozuelo de Alarcon, Madrid, Spain
| | - Fernando Maestú
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, 28223 Pozuelo de Alarcon, Madrid, Spain
| | - Alexander N Pisarchik
- Artificial Intelligence Systems and Neurotechnologies, Yuri Gagarin State Technical University of Saratov, Politehnicheskaya, 77, Saratov 410054, Russia
| |
Collapse
|
23
|
Maksimenko VA, Runnova AE, Zhuravlev MO, Makarov VV, Nedayvozov V, Grubov VV, Pchelintceva SV, Hramov AE, Pisarchik AN. Visual perception affected by motivation and alertness controlled by a noninvasive brain-computer interface. PLoS One 2017; 12:e0188700. [PMID: 29267295 PMCID: PMC5739396 DOI: 10.1371/journal.pone.0188700] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2017] [Accepted: 11/11/2017] [Indexed: 11/19/2022] Open
Abstract
The influence of motivation and alertness on brain activity associated with visual perception was studied experimentally using the Necker cube, which ambiguity was controlled by the contrast of its ribs. The wavelet analysis of recorded multichannel electroencephalograms (EEG) allowed us to distinguish two different scenarios while the brain processed the ambiguous stimulus. The first scenario is characterized by a particular destruction of alpha rhythm (8–12 Hz) with a simultaneous increase in beta-wave activity (20–30 Hz), whereas in the second scenario, the beta rhythm is not well pronounced while the alpha-wave energy remains unchanged. The experiments were carried out with a group of financially motivated subjects and another group of unpaid volunteers. It was found that the first scenario occurred mainly in the motivated group. This can be explained by the increased alertness of the motivated subjects. The prevalence of the first scenario was also observed in a group of subjects to whom images with higher ambiguity were presented. We believe that the revealed scenarios can occur not only during the perception of bistable images, but also in other perceptual tasks requiring decision making. The obtained results may have important applications for monitoring and controlling human alertness in situations which need substantial attention. On the base of the obtained results we built a brain-computer interface to estimate and control the degree of alertness in real time.
Collapse
Affiliation(s)
- Vladimir A. Maksimenko
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Anastasia E. Runnova
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Maksim O. Zhuravlev
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Vladimir V. Makarov
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Vladimir Nedayvozov
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Vadim V. Grubov
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Svetlana V. Pchelintceva
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Alexander E. Hramov
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
| | - Alexander N. Pisarchik
- Yuri Gagarin Technical State University of Saratov, Politehnicheskaya, 77, 410054 Saratov, Russia
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, 28223 Pozuelo de Alarcon, Madrid, Spain
- * E-mail:
| |
Collapse
|
24
|
Hramov AE, Maksimenko VA, Pchelintseva SV, Runnova AE, Grubov VV, Musatov VY, Zhuravlev MO, Koronovskii AA, Pisarchik AN. Classifying the Perceptual Interpretations of a Bistable Image Using EEG and Artificial Neural Networks. Front Neurosci 2017; 11:674. [PMID: 29255403 PMCID: PMC5722852 DOI: 10.3389/fnins.2017.00674] [Citation(s) in RCA: 68] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2017] [Accepted: 11/20/2017] [Indexed: 01/04/2023] Open
Abstract
In order to classify different human brain states related to visual perception of ambiguous images, we use an artificial neural network (ANN) to analyze multichannel EEG. The classifier built on the basis of a multilayer perceptron achieves up to 95% accuracy in classifying EEG patterns corresponding to two different interpretations of the Necker cube. The important feature of our classifier is that trained on one subject it can be used for the classification of EEG traces of other subjects. This result suggests the existence of common features in the EEG structure associated with distinct interpretations of bistable objects. We firmly believe that the significance of our results is not limited to visual perception of the Necker cube images; the proposed experimental approach and developed computational technique based on ANN can also be applied to study and classify different brain states using neurophysiological data recordings. This may give new directions for future research in the field of cognitive and pathological brain activity, and for the development of brain-computer interfaces.
Collapse
Affiliation(s)
- Alexander E Hramov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Faculty of Nonlinear Processes, Saratov State University, Saratov, Russia
| | - Vladimir A Maksimenko
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Svetlana V Pchelintseva
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Anastasiya E Runnova
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vadim V Grubov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vyacheslav Yu Musatov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Maksim O Zhuravlev
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Faculty of Nonlinear Processes, Saratov State University, Saratov, Russia
| | - Alexey A Koronovskii
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Faculty of Nonlinear Processes, Saratov State University, Saratov, Russia
| | - Alexander N Pisarchik
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Center for Biomedical Technology, Technical University of Madrid, Madrid, Spain
| |
Collapse
|
25
|
Beig MT, Svenkeson A, Bologna M, West BJ, Grigolini P. Critical slowing down in networks generating temporal complexity. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2015; 91:012907. [PMID: 25679682 DOI: 10.1103/physreve.91.012907] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2014] [Indexed: 06/04/2023]
Abstract
We study a nonlinear Langevin equation describing the dynamic variable X(t), the mean field (order parameter) of a finite size complex network at criticality. The conditions under which the autocorrelation function of X shows any direct connection with criticality are discussed. We find that if the network is prepared in a state far from equilibrium, X(0)=1, the autocorrelation function is characterized by evident signs of critical slowing down as well as by significant aging effects, while the preparation X(0)=0 does not generate evident signs of criticality on X(t), in spite of the fact that the same initial state makes the fluctuating variable η(t)≡sgn(X(t)) yield significant aging effects. These latter effects arise because the dynamics of η(t) are directly dependent on crucial events, namely the re-crossings of the origin, which undergo a significant aging process with the preparation X(0)=0. The time scale dominated by temporal complexity, aging, and ergodicity breakdown of η(t) is properly evaluated by adopting the method of stochastic linearization which is used to explain the exponential-like behavior of the equilibrium autocorrelation function of X(t).
Collapse
Affiliation(s)
- M T Beig
- Center for Nonlinear Science, University of North Texas, Denton, Texas 76203, USA
| | - A Svenkeson
- Army Research Laboratory, 2800 Powder Mill Road, Adelphi, Maryland 20883, USA
| | - M Bologna
- Instituto de Alta Investigación, Universidad de Tarapacá, Casilla 6-D, Arica, Chile
| | - B J West
- Information Sciences Directorate, Army Research Office, Research Triangle Park, North Carolina 27709, USA
| | - P Grigolini
- Center for Nonlinear Science, University of North Texas, Denton, Texas 76203, USA
| |
Collapse
|