1
|
Grenzebach J, Wegner TGG, Einhäuser W, Bendixen A. Bimodal moment-by-moment coupling in perceptual multistability. J Vis 2024; 24:16. [PMID: 38819806 PMCID: PMC11146044 DOI: 10.1167/jov.24.5.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 04/18/2024] [Indexed: 06/01/2024] Open
Abstract
Multistable perception occurs in all sensory modalities, and there is ongoing theoretical debate about whether there are overarching mechanisms driving multistability across modalities. Here we study whether multistable percepts are coupled across vision and audition on a moment-by-moment basis. To assess perception simultaneously for both modalities without provoking a dual-task situation, we query auditory perception by direct report, while measuring visual perception indirectly via eye movements. A support-vector-machine (SVM)-based classifier allows us to decode visual perception from the eye-tracking data on a moment-by-moment basis. For each timepoint, we compare visual percept (SVM output) and auditory percept (report) and quantify the co-occurrence of integrated (one-object) or segregated (two-objects) interpretations in the two modalities. Our results show an above-chance coupling of auditory and visual perceptual interpretations. By titrating stimulus parameters toward an approximately symmetric distribution of integrated and segregated percepts for each modality and individual, we minimize the amount of coupling expected by chance. Because of the nature of our task, we can rule out that the coupling stems from postperceptual levels (i.e., decision or response interference). Our results thus indicate moment-by-moment perceptual coupling in the resolution of visual and auditory multistability, lending support to theories that postulate joint mechanisms for multistable perception across the senses.
Collapse
Affiliation(s)
- Jan Grenzebach
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Thomas G G Wegner
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Wolfgang Einhäuser
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- https://www.tu-chemnitz.de/physik/PHKP/index.html.en
| | - Alexandra Bendixen
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- https://www.tu-chemnitz.de/physik/SFKS/index.html.en
| |
Collapse
|
2
|
Kondo HM, Hasegawa R, Ezaki T, Sakata H, Ho HT. Functional coupling between auditory memory and verbal transformations. Sci Rep 2024; 14:3480. [PMID: 38347058 PMCID: PMC10861569 DOI: 10.1038/s41598-024-54013-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 02/07/2024] [Indexed: 02/15/2024] Open
Abstract
The ability to parse sound mixtures into coherent auditory objects is fundamental to cognitive functions, such as speech comprehension and language acquisition. Yet, we still lack a clear understanding of how auditory objects are formed. To address this question, we studied a speech-specific case of perceptual multistability, called verbal transformations (VTs), in which a variety of verbal forms is induced by continuous repetition of a physically unchanging word. Here, we investigated the degree to which auditory memory through sensory adaptation influences VTs. Specifically, we hypothesized that when memory persistence is longer, participants are able to retain the current verbal form longer, resulting in sensory adaptation, which in turn, affects auditory perception. Participants performed VT and auditory memory tasks on different days. In the VT task, Japanese participants continuously reported their perception while listening to a Japanese word (2- or 3-mora in length) played repeatedly for 5 min. In the auditory memory task, a different sequence of three morae, e.g., /ka/, /hi/, and /su/, was presented to each ear simultaneously. After some period (0-4 s), participants were visually cued to recall one of the sequences, i.e., in the left or right ear. We found that delayed recall accuracy was negatively correlated with the number of VTs, particularly under 2-mora conditions. This suggests that memory persistence is important for formation and selection of perceptual objects.
Collapse
Affiliation(s)
- Hirohito M Kondo
- School of Psychology, Chukyo University, 101-2 Yagoto Honmachi, Showa, Nagoya, Aichi, 466-8666, Japan.
| | - Ryuju Hasegawa
- School of Psychology, Chukyo University, 101-2 Yagoto Honmachi, Showa, Nagoya, Aichi, 466-8666, Japan
| | - Takahiro Ezaki
- Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Honami Sakata
- School of Psychology, Chukyo University, 101-2 Yagoto Honmachi, Showa, Nagoya, Aichi, 466-8666, Japan
| | - Hao Tam Ho
- School of Psychology, Chukyo University, 101-2 Yagoto Honmachi, Showa, Nagoya, Aichi, 466-8666, Japan
- Département d'études Cognitives, École Normale Supérieure, Paris, France
| |
Collapse
|
3
|
Kondo HM, Terashima H, Kihara K, Kochiyama T, Shimada Y, Kawahara JI. Prefrontal GABA and glutamate-glutamine levels affect sustained attention. Cereb Cortex 2023; 33:10441-10452. [PMID: 37562851 PMCID: PMC10545440 DOI: 10.1093/cercor/bhad294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Revised: 07/22/2023] [Accepted: 07/23/2023] [Indexed: 08/12/2023] Open
Abstract
Attention levels fluctuate during the course of daily activities. However, factors underlying sustained attention are still unknown. We investigated mechanisms of sustained attention using psychological, neuroimaging, and neurochemical approaches. Participants were scanned with functional magnetic resonance imaging (fMRI) while performing gradual-onset, continuous performance tasks (gradCPTs). In gradCPTs, narrations or visual scenes gradually changed from one to the next. Participants pressed a button for frequent Go trials as quickly as possible and withheld responses to infrequent No-go trials. Performance was better for the visual gradCPT than for the auditory gradCPT, but the 2 were correlated. The dorsal attention network was activated during intermittent responses, regardless of sensory modality. Reaction-time variability of gradCPTs was correlated with signal changes (SCs) in the left fronto-parietal regions. We also used magnetic resonance spectroscopy (MRS) to measure levels of glutamate-glutamine (Glx) and γ-aminobutyric acid (GABA) in the left prefrontal cortex (PFC). Glx levels were associated with performance under undemanding situations, whereas GABA levels were related to performance under demanding situations. Combined fMRI-MRS results demonstrated that SCs of the left PFC were positively correlated with neurometabolite levels. These findings suggest that a neural balance between excitation and inhibition is involved in attentional fluctuations and brain dynamics.
Collapse
Affiliation(s)
- Hirohito M Kondo
- Department of Psychology, School of Psychology, Chukyo University, Nagoya, Aichi 466-8666, Japan
| | - Hiroki Terashima
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
| | - Ken Kihara
- Department of Information Technology and Human Factors, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Ibaraki 305-8566, Japan
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto 619-0288, Japan
| | - Yasuhiro Shimada
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto 619-0288, Japan
| | - Jun I Kawahara
- Department of Psychology, Hokkaido University, Sapporo, Hokkaido 060-0810, Japan
| |
Collapse
|
4
|
Gurariy G, Randall R, Greenberg AS. Neuroimaging evidence for the direct role of auditory scene analysis in object perception. Cereb Cortex 2023; 33:6257-6272. [PMID: 36562994 PMCID: PMC10183742 DOI: 10.1093/cercor/bhac501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/24/2022] Open
Abstract
Auditory Scene Analysis (ASA) refers to the grouping of acoustic signals into auditory objects. Previously, we have shown that perceived musicality of auditory sequences varies with high-level organizational features. Here, we explore the neural mechanisms mediating ASA and auditory object perception. Participants performed musicality judgments on randomly generated pure-tone sequences and manipulated versions of each sequence containing low-level changes (amplitude; timbre). Low-level manipulations affected auditory object perception as evidenced by changes in musicality ratings. fMRI was used to measure neural activation to sequences rated most and least musical, and the altered versions of each sequence. Next, we generated two partially overlapping networks: (i) a music processing network (music localizer) and (ii) an ASA network (base sequences vs. ASA manipulated sequences). Using Representational Similarity Analysis, we correlated the functional profiles of each ROI to a model generated from behavioral musicality ratings as well as models corresponding to low-level feature processing and music perception. Within overlapping regions, areas near primary auditory cortex correlated with low-level ASA models, whereas right IPS was correlated with musicality ratings. Shared neural mechanisms that correlate with behavior and underlie both ASA and music perception suggests that low-level features of auditory stimuli play a role in auditory object perception.
Collapse
Affiliation(s)
- Gennadiy Gurariy
- Department of Biomedical Engineering, Medical College of Wisconsin and Marquette University, 8701 W Watertown Plank Rd, Milwaukee, WI 53233, United States
| | - Richard Randall
- School of Music and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, United States
| | - Adam S Greenberg
- Department of Biomedical Engineering, Medical College of Wisconsin and Marquette University, 8701 W Watertown Plank Rd, Milwaukee, WI 53233, United States
| |
Collapse
|
5
|
Higgins NC, Scurry AN, Jiang F, Little DF, Alain C, Elhilali M, Snyder JS. Adaptation in the sensory cortex drives bistable switching during auditory stream segregation. Neurosci Conscious 2023; 2023:niac019. [PMID: 36751309 PMCID: PMC9899071 DOI: 10.1093/nc/niac019] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 10/17/2022] [Accepted: 12/26/2022] [Indexed: 02/06/2023] Open
Abstract
Current theories of perception emphasize the role of neural adaptation, inhibitory competition, and noise as key components that lead to switches in perception. Supporting evidence comes from neurophysiological findings of specific neural signatures in modality-specific and supramodal brain areas that appear to be critical to switches in perception. We used functional magnetic resonance imaging to study brain activity around the time of switches in perception while participants listened to a bistable auditory stream segregation stimulus, which can be heard as one integrated stream of tones or two segregated streams of tones. The auditory thalamus showed more activity around the time of a switch from segregated to integrated compared to time periods of stable perception of integrated; in contrast, the rostral anterior cingulate cortex and the inferior parietal lobule showed more activity around the time of a switch from integrated to segregated compared to time periods of stable perception of segregated streams, consistent with prior findings of asymmetries in brain activity depending on the switch direction. In sound-responsive areas in the auditory cortex, neural activity increased in strength preceding switches in perception and declined in strength over time following switches in perception. Such dynamics in the auditory cortex are consistent with the role of adaptation proposed by computational models of visual and auditory bistable switching, whereby the strength of neural activity decreases following a switch in perception, which eventually destabilizes the current percept enough to lead to a switch to an alternative percept.
Collapse
Affiliation(s)
- Nathan C Higgins
- Department of Communication Sciences and Disorders, University of South Florida, 4202 E. Fowler Avenue, PCD1017, Tampa, FL 33620, USA
| | - Alexandra N Scurry
- Department of Psychology, University of Nevada, 1664 N. Virginia Street Mail Stop 0296, Reno, NV 89557, USA
| | - Fang Jiang
- Department of Psychology, University of Nevada, 1664 N. Virginia Street Mail Stop 0296, Reno, NV 89557, USA
| | - David F Little
- Department of Electrical and Computer Engineering, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD 21218, USA
| | - Claude Alain
- Rotman Research Institute, Baycrest Health Sciences, 3560 Bathurst Street, Toronto, ON M6A 2E1, Canada
| | - Mounya Elhilali
- Department of Electrical and Computer Engineering, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD 21218, USA
| | - Joel S Snyder
- Department of Psychology, University of Nevada, 4505 Maryland Parkway Mail Stop 5030, Las Vegas, NV 89154, USA
| |
Collapse
|
6
|
Kondo HM, Terashima H, Ezaki T, Kochiyama T, Kihara K, Kawahara JI. Dynamic Transitions Between Brain States Predict Auditory Attentional Fluctuations. Front Neurosci 2022; 16:816735. [PMID: 35368290 PMCID: PMC8972573 DOI: 10.3389/fnins.2022.816735] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 02/23/2022] [Indexed: 11/23/2022] Open
Abstract
Achievement of task performance is required to maintain a constant level of attention. Attentional level fluctuates over the course of daily activities. However, brain dynamics leading to attentional fluctuation are still unknown. We investigated the underlying mechanisms of sustained attention using functional magnetic resonance imaging (fMRI). Participants were scanned with fMRI while performing an auditory, gradual-onset, continuous performance task (gradCPT). In this task, narrations gradually changed from one to the next. Participants pressed a button for frequent Go trials (i.e., male voices) as quickly as possible and withheld responses to infrequent No-go trials (i.e., female voices). Event-related analysis revealed that frontal and temporal areas, including the auditory cortex, were activated during successful and unsuccessful inhibition of predominant responses. Reaction-time (RT) variability throughout the auditory gradCPT was positively correlated with signal changes in regions of the dorsal attention network: superior frontal gyrus and superior parietal lobule. Energy landscape analysis showed that task-related activations could be clustered into different attractors: regions of the dorsal attention network and default mode network. The number of alternations between RT-stable and erratic periods increased with an increase in transitions between attractors in the brain. Therefore, we conclude that dynamic transitions between brain states are closely linked to auditory attentional fluctuations.
Collapse
Affiliation(s)
- Hirohito M. Kondo
- School of Psychology, Chukyo University, Nagoya, Japan
- *Correspondence: Hirohito M. Kondo,
| | - Hiroki Terashima
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Atsugi, Japan
| | - Takahiro Ezaki
- Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo, Japan
| | | | - Ken Kihara
- Department of Information Technology and Human Factors, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan
| | - Jun I. Kawahara
- Department of Psychology, Hokkaido University, Sapporo, Japan
| |
Collapse
|
7
|
Suzuki Y, Liao H, Furukawa S. Temporal dynamics of auditory bistable perception correlated with fluctuation of baseline pupil size. Psychophysiology 2022; 59:e14028. [PMID: 35226355 PMCID: PMC9541800 DOI: 10.1111/psyp.14028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 01/24/2022] [Accepted: 01/24/2022] [Indexed: 11/29/2022]
Abstract
A dynamic neural network change, accompanied by cognitive shifts such as internal perceptual alternation in bistable stimuli, is reconciled by the discharge of noradrenergic locus coeruleus neurons. Transient pupil dilation as a consequence of the reconciliation with the neural network in bistable perception has been reported to precede the reported perceptual alternation. Here, we found that baseline pupil size, an index of temporal fluctuation of arousal level over a longer range of timescales than that for the transient pupil changes, relates to the frequency of perceptual alternation in auditory bistability. Baseline pupil size was defined as the mean pupil diameter over a period of 1 s prior to the task requirement (i.e., before the observation period for counting the perceptual alternations in Experiment 1 and reporting whether participants experienced the perceptual alternations in Experiment 2). The results showed that the baseline pupil size monotonically increased with an increasing number of perceptual alternations and its occurrence probability. Furthermore, a cross‐correlation analysis indicates that baseline pupil size predicted perceptual alternation at least 35 s before the behavioral response and that the overall correspondence between pupil size and perceptual alternation was maintained over a sustained time window of 45 s at minimum. The overall results suggest that variability of baseline pupil size reflects the stochastic dynamics of arousal fluctuation in the brain related to bistable perception.
Collapse
Affiliation(s)
- Yuta Suzuki
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| | - Hsin‐I Liao
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| |
Collapse
|
8
|
Li H, Heise KF, Chalavi S, Puts NAJ, Edden RAE, Swinnen SP. The role of MRS-assessed GABA in human behavioral performance. Prog Neurobiol 2022; 212:102247. [PMID: 35149113 DOI: 10.1016/j.pneurobio.2022.102247] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Revised: 01/25/2022] [Accepted: 02/04/2022] [Indexed: 01/16/2023]
Abstract
Understanding the neurophysiological mechanisms that drive human behavior has been a long-standing focus of cognitive neuroscience. One well-known neuro-metabolite involved in the creation of optimal behavioral repertoires is GABA, the main inhibitory neurochemical in the human brain. Converging evidence from both animal and human studies indicates that individual variations in GABAergic function are associated with behavioral performance. In humans, one increasingly used in vivo approach to measuring GABA levels is through Magnetic Resonance Spectroscopy (MRS). However, the implications of MRS measures of GABA for behavior remain poorly understood. In this respect, it is yet to be determined how GABA levels within distinct task-related brain regions of interest account for differences in behavioral performance. This review summarizes findings from cross-sectional studies that determined baseline MRS-assessed GABA levels and examined their associations with performance on various behaviors representing the perceptual, motor and cognitive domains, with a particular focus on healthy participants across the lifespan. Overall, the results indicate that MRS-assessed GABA levels play a pivotal role in various domains of behavior. Even though some converging patterns emerge, it is challenging to draw comprehensive conclusions due to differences in behavioral task paradigms, targeted brain regions of interest, implemented MRS techniques and reference compounds used. Across all studies, the effects of GABA levels on behavioral performance point to generic and partially independent functions that refer to distinctiveness, interference suppression and cognitive flexibility. On one hand, higher baseline GABA levels may support the distinctiveness of neural representations during task performance and better coping with interference and suppression of preferred response tendencies. On the other hand, lower baseline GABA levels may support a reduction of inhibition, leading to higher cognitive flexibility. These effects are task-dependent and appear to be mediated by age. Nonetheless, additional studies using emerging advanced methods are required to further clarify the role of MRS-assessed GABA in behavioral performance.
Collapse
Affiliation(s)
- Hong Li
- Movement Control & Neuroplasticity Research Group, Group Biomedical Sciences, KU Leuven, Belgium; KU Leuven Brain Institute (LBI), KU Leuven, Belgium.
| | - Kirstin-Friederike Heise
- Movement Control & Neuroplasticity Research Group, Group Biomedical Sciences, KU Leuven, Belgium; KU Leuven Brain Institute (LBI), KU Leuven, Belgium; Department of Health Sciences and Research, Medical University of South Carolina, Charleston, SC, USA.
| | - Sima Chalavi
- Movement Control & Neuroplasticity Research Group, Group Biomedical Sciences, KU Leuven, Belgium; KU Leuven Brain Institute (LBI), KU Leuven, Belgium.
| | - Nicolaas A J Puts
- MRC Centre for Neurodevelopmental Disorders, King's College London, London, UK; Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology, and Neuroscience, King's College London, London, UK; Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA; F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA.
| | - Richard A E Edden
- Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA; F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
| | - Stephan P Swinnen
- Movement Control & Neuroplasticity Research Group, Group Biomedical Sciences, KU Leuven, Belgium; KU Leuven Brain Institute (LBI), KU Leuven, Belgium.
| |
Collapse
|
9
|
Attentional control via synaptic gain mechanisms in auditory streaming. Brain Res 2021; 1778:147720. [PMID: 34785256 DOI: 10.1016/j.brainres.2021.147720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 09/13/2021] [Accepted: 11/05/2021] [Indexed: 11/21/2022]
Abstract
Attention is a crucial component in sound source segregation allowing auditory objects of interest to be both singled out and held in focus. Our study utilizes a fundamental paradigm for sound source segregation: a sequence of interleaved tones, A and B, of different frequencies that can be heard as a single integrated stream or segregated into two streams (auditory streaming paradigm). We focus on the irregular alternations between integrated and segregated that occur for long presentations, so-called auditory bistability. Psychaoustic experiments demonstrate how attentional control, a listener's intention to experience integrated or segregated, biases perception in favour of different perceptual interpretations. Our data show that this is achieved by prolonging the dominance times of the attended percept and, to a lesser extent, by curtailing the dominance times of the unattended percept, an effect that remains consistent across a range of values for the difference in frequency between A and B. An existing neuromechanistic model describes the neural dynamics of perceptual competition downstream of primary auditory cortex (A1). The model allows us to propose plausible neural mechanisms for attentional control, as linked to different attentional strategies, in a direct comparison with behavioural data. A mechanism based on a percept-specific input gain best accounts for the effects of attentional control.
Collapse
|
10
|
Higgins NC, Monjaras AG, Yerkes BD, Little DF, Nave-Blodgett JE, Elhilali M, Snyder JS. Resetting of Auditory and Visual Segregation Occurs After Transient Stimuli of the Same Modality. Front Psychol 2021; 12:720131. [PMID: 34621219 PMCID: PMC8490814 DOI: 10.3389/fpsyg.2021.720131] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 08/16/2021] [Indexed: 12/03/2022] Open
Abstract
In the presence of a continually changing sensory environment, maintaining stable but flexible awareness is paramount, and requires continual organization of information. Determining which stimulus features belong together, and which are separate is therefore one of the primary tasks of the sensory systems. Unknown is whether there is a global or sensory-specific mechanism that regulates the final perceptual outcome of this streaming process. To test the extent of modality independence in perceptual control, an auditory streaming experiment, and a visual moving-plaid experiment were performed. Both were designed to evoke alternating perception of an integrated or segregated percept. In both experiments, transient auditory and visual distractor stimuli were presented in separate blocks, such that the distractors did not overlap in frequency or space with the streaming or plaid stimuli, respectively, thus preventing peripheral interference. When a distractor was presented in the opposite modality as the bistable stimulus (visual distractors during auditory streaming or auditory distractors during visual streaming), the probability of percept switching was not significantly different than when no distractor was presented. Conversely, significant differences in switch probability were observed following within-modality distractors, but only when the pre-distractor percept was segregated. Due to the modality-specificity of the distractor-induced resetting, the results suggest that conscious perception is at least partially controlled by modality-specific processing. The fact that the distractors did not have peripheral overlap with the bistable stimuli indicates that the perceptual reset is due to interference at a locus in which stimuli of different frequencies and spatial locations are integrated.
Collapse
Affiliation(s)
- Nathan C Higgins
- Department of Psychology, University of Nevada Las Vegas, Las Vegas, NV, United States
| | - Ambar G Monjaras
- Department of Psychology, University of Nevada Las Vegas, Las Vegas, NV, United States
| | - Breanne D Yerkes
- Department of Psychology, University of Nevada Las Vegas, Las Vegas, NV, United States
| | - David F Little
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
| | | | - Mounya Elhilali
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Joel S Snyder
- Department of Psychology, University of Nevada Las Vegas, Las Vegas, NV, United States
| |
Collapse
|
11
|
Pálffy Z, Farkas K, Csukly G, Kéri S, Polner B. Cross-modal auditory priors drive the perception of bistable visual stimuli with reliable differences between individuals. Sci Rep 2021; 11:16943. [PMID: 34417496 PMCID: PMC8379237 DOI: 10.1038/s41598-021-96198-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 05/27/2021] [Indexed: 11/17/2022] Open
Abstract
It is a widely held assumption that the brain performs perceptual inference by combining sensory information with prior expectations, weighted by their uncertainty. A distinction can be made between higher- and lower-level priors, which can be manipulated with associative learning and sensory priming, respectively. Here, we simultaneously investigate priming and the differential effect of auditory vs. visual associative cues on visual perception, and we also examine the reliability of individual differences. Healthy individuals (N = 29) performed a perceptual inference task twice with a one-week delay. They reported the perceived direction of motion of dot pairs, which were preceded by a probabilistic visuo-acoustic cue. In 30% of the trials, motion direction was ambiguous, and in half of these trials, the auditory versus the visual cue predicted opposing directions. Cue-stimulus contingency could change every 40 trials. On ambiguous trials where the visual and the auditory cue predicted conflicting directions of motion, participants made more decisions consistent with the prediction of the acoustic cue. Increased predictive processing under stimulus uncertainty was indicated by slower responses to ambiguous (vs. non-ambiguous) stimuli. Furthermore, priming effects were also observed in that perception of ambiguous stimuli was influenced by perceptual decisions on the previous ambiguous and unambiguous trials as well. Critically, behavioural effects had substantial inter-individual variability which showed high test-retest reliability (intraclass correlation coefficient (ICC) > 0.78). Overall, higher-level priors based on auditory (vs. visual) information had greater influence on visual perception, and lower-level priors were also in action. Importantly, we observed large and stable differences in various aspects of task performance. Computational modelling combined with neuroimaging could allow testing hypotheses regarding the potential mechanisms causing these behavioral effects. The reliability of the behavioural differences implicates that such perceptual inference tasks could be valuable tools during large-scale biomarker and neuroimaging studies.
Collapse
Affiliation(s)
- Zsófia Pálffy
- Department of Cognitive Science, Budapest University of Technology and Economics, 1 Egry József utca, Building T, Floor 5, Budapest, 1111, Hungary.
| | - Kinga Farkas
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Gábor Csukly
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Szabolcs Kéri
- Department of Cognitive Science, Budapest University of Technology and Economics, 1 Egry József utca, Building T, Floor 5, Budapest, 1111, Hungary
- National Institute of Psychiatry and Addictions, Budapest, Hungary
| | - Bertalan Polner
- Department of Cognitive Science, Budapest University of Technology and Economics, 1 Egry József utca, Building T, Floor 5, Budapest, 1111, Hungary
| |
Collapse
|
12
|
Ferrario A, Rankin J. Auditory streaming emerges from fast excitation and slow delayed inhibition. JOURNAL OF MATHEMATICAL NEUROSCIENCE 2021; 11:8. [PMID: 33939042 PMCID: PMC8093365 DOI: 10.1186/s13408-021-00106-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Accepted: 04/22/2021] [Indexed: 05/29/2023]
Abstract
In the auditory streaming paradigm, alternating sequences of pure tones can be perceived as a single galloping rhythm (integration) or as two sequences with separated low and high tones (segregation). Although studied for decades, the neural mechanisms underlining this perceptual grouping of sound remains a mystery. With the aim of identifying a plausible minimal neural circuit that captures this phenomenon, we propose a firing rate model with two periodically forced neural populations coupled by fast direct excitation and slow delayed inhibition. By analyzing the model in a non-smooth, slow-fast regime we analytically prove the existence of a rich repertoire of dynamical states and of their parameter dependent transitions. We impose plausible parameter restrictions and link all states with perceptual interpretations. Regions of stimulus parameters occupied by states linked with each percept match those found in behavioural experiments. Our model suggests that slow inhibition masks the perception of subsequent tones during segregation (forward masking), whereas fast excitation enables integration for large pitch differences between the two tones.
Collapse
Affiliation(s)
- Andrea Ferrario
- Department of Mathematics, College of Engineering, Mathematics & Physical Sciences, University of Exeter, Exeter, UK.
| | - James Rankin
- Department of Mathematics, College of Engineering, Mathematics & Physical Sciences, University of Exeter, Exeter, UK
| |
Collapse
|
13
|
Terashima H, Kihara K, Kawahara JI, Kondo HM. Common principles underlie the fluctuation of auditory and visual sustained attention. Q J Exp Psychol (Hove) 2020; 74:705-715. [PMID: 33103992 PMCID: PMC8044612 DOI: 10.1177/1747021820972255] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Sustained attention plays an important role in adaptive behaviours in everyday activities. As previous studies have mostly focused on vision, and attentional resources have been thought to be specific to sensory modalities, it is still unclear how mechanisms of attentional fluctuations overlap between visual and auditory modalities. To reduce the effects of sudden stimulus onsets, we developed a new gradual-onset continuous performance task (gradCPT) in the auditory domain and compared dynamic fluctuation of sustained attention in vision and audition. In the auditory gradCPT, participants were instructed to listen to a stream of narrations and judge the gender of each narration. In the visual gradCPT, they were asked to observe a stream of scenery images and indicate whether the scene was a city or mountain. Our within-individual comparison revealed that auditory and visual attention are similar in terms of the false alarm rate and dynamic properties including fluctuation frequency. Absolute timescales of the fluctuation in the two modalities were comparable, notwithstanding the difference in stimulus onset asynchrony. The results suggest that fluctuations of visual and auditory attention are underpinned by common principles and support models with a more central, modality-general controller.
Collapse
Affiliation(s)
- Hiroki Terashima
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone, Atsugi, Japan
| | - Ken Kihara
- Department of Information Technology and Human Factors, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan
| | - Jun I Kawahara
- Department of Psychology, Hokkaido University, Sapporo, Japan
| | - Hirohito M Kondo
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone, Atsugi, Japan.,School of Psychology, Chukyo University, Nagoya, Japan
| |
Collapse
|
14
|
Neurometabolic underpinning of the intergenerational transmission of prosociality. Neuroimage 2020; 218:116965. [PMID: 32461150 DOI: 10.1016/j.neuroimage.2020.116965] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Revised: 04/26/2020] [Accepted: 05/15/2020] [Indexed: 12/13/2022] Open
Abstract
Parent-child personality transmission can occur via biological gene-driven processes as well as through environmental factors such as shared environment and parenting style. We recently revealed a negative association between prosociality, a highly valued personality attribute in human society, and anterior cingulate cortex (ACC) γ-aminobutyric acid (GABA) levels in children at the age of 10 years. We thus hypothesized that prosociality would be intergenerationally transmitted, and that transmission would be underwritten by neurometabolic heritability. Here, we collected prosociality data from children aged 10 years and their parents in a large-scale population-based birth cohort study. We also measured ACC GABA+ and glutamate plus glutamine (Glx) levels in a follow-up assessment with a subsample of the participants (aged 11 years) using magnetic resonance spectroscopy. We analyzed the associations among children's and parents' prosociality and GABA+/Glx ratios. We also examined the effect of socioeconomic status (SES) and verbalized parental affection (VPA) on these associations. We found a significant positive parent-child association for prosociality (N = 3026; children's mean age 10.2 years) and GABA+/Glx ratio (N = 99; children's mean age 11.4 years). There was a significant negative association between GABA+/Glx ratio and prosociality in both children (N = 208) and parents (N = 128). Our model accounting for the effects of neurometabolic heritability on prosociality transmission fitted well. Moreover, in this model, a significant positive effect of VPA but not SES on children's prosociality was observed independently of the effect of neurometabolic transmission, while SES but not VPA was significantly associated with parental prosociality. Our results provide novel insights into the neurometabolic substrates of parent-child transmission of social behavior.
Collapse
|
15
|
Kondo HM, Lin IF. Excitation-inhibition balance and auditory multistable perception are correlated with autistic traits and schizotypy in a non-clinical population. Sci Rep 2020; 10:8171. [PMID: 32424307 PMCID: PMC7234986 DOI: 10.1038/s41598-020-65126-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Accepted: 04/27/2020] [Indexed: 12/20/2022] Open
Abstract
Individuals with autism spectrum disorder and individuals with schizophrenia have impaired social and communication skills. They also have altered auditory perception. This study investigated autistic traits and schizotypy in a non-clinical population as well as the excitation-inhibition (EI) balance in different brain regions and their auditory multistable perception. Thirty-four healthy participants were assessed by the Autism-Spectrum Quotient (AQ) and Schizotypal Personality Questionnaire (SPQ). The EI balance was evaluated by measuring the resting-state concentrations of glutamate-glutamine (Glx) and ϒ-aminobutyric acid (GABA) in vivo by using magnetic resonance spectroscopy. To observe the correlation between their traits and perception, we conducted an auditory streaming task and a verbal transformation task, in which participants reported spontaneous perceptual switching while listening to a sound sequence. Their AQ and SPQ scores were positively correlated with the Glx/GABA ratio in the auditory cortex but not in the frontal areas. These scores were negatively correlated with the number of perceptual switches in the verbal transformation task but not in the auditory streaming task. Our results suggest that the EI balance in the auditory cortex and the perceptual formation of speech are involved in autistic traits and schizotypy.
Collapse
Affiliation(s)
- Hirohito M Kondo
- School of Psychology, Chukyo University, Nagoya, Aichi, 466-8666, Japan. .,Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, 243-0198, Japan.
| | - I-Fan Lin
- Department of Occupational Medicine, Shuang Ho Hospital, New Taipei City, 235, Taiwan.,Department of Medicine, Taipei Medical University, Taipei, 110, Taiwan
| |
Collapse
|
16
|
Gosztonyi G, Ludwig H, Bode L, Kao M, Sell M, Petrusz P, Halász B. Obesity induced by Borna disease virus in rats: key roles of hypothalamic fast-acting neurotransmitters and inflammatory infiltrates. Brain Struct Funct 2020; 225:1459-1482. [PMID: 32394093 DOI: 10.1007/s00429-020-02063-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Accepted: 03/21/2020] [Indexed: 12/30/2022]
Abstract
Human obesity epidemic is increasing worldwide with major adverse consequences on health. Among other possible causes, the hypothesis of an infectious contribution is worth it to be considered. Here, we report on an animal model of virus-induced obesity which might help to better understand underlying processes in human obesity. Eighty Wistar rats, between 30 and 60 days of age, were intracerebrally inoculated with Borna disease virus (BDV-1), a neurotropic negative-strand RNA virus infecting an unusually broad host spectrum including humans. Half of the rats developed fatal encephalitis, while the other half, after 3-4 months, continuously gained weight. At tripled weights, rats were sacrificed by trans-cardial fixative perfusion. Neuropathology revealed prevailing inflammatory infiltrates in the median eminence (ME), progressive degeneration of neurons of the paraventricular nucleus, the entorhinal cortex and the amygdala, and a strikingly high-grade involution of the hippocampus with hydrocephalus. Immune histology revealed that major BDV-1 antigens were preferentially present at glutamatergic receptor sites, while GABAergic areas remained free from BDV-1. Virus-induced suppression of the glutamatergic system caused GABAergic predominance. In the hypothalamus, this shifted the energy balance to the anabolic appetite-stimulating side governed by GABA, allowing for excessive fat accumulation in obese rats. Furthermore, inflammatory infiltrates in the ME and ventro-medial arcuate nucleus hindered free access of appetite-suppressing hormones leptin and insulin. The hormone transport system in hypothalamic areas outside the ME became blocked by excessively produced leptin, leading to leptin resistance. The resulting hyperleptinemic milieu combined with suppressed glutamatergic mechanisms was a characteristic feature of the found metabolic pathology. In conclusion, the study provided clear evidence that BDV-1 induced obesity in the rat model is the result of interdependent structural and functional metabolic changes. They can be explained by an immunologically induced hypothalamic microcirculation-defect, combined with a disturbance of neurotransmitter regulatory systems. The proposed mechanism may also have implications for human health. BDV-1 infection has been frequently found in depressive patients. Independently, comorbidity between depression and obesity has been reported, either. Future studies should address the exciting question of whether BDV-1 infection could be a link, whatsoever, between these two conditions.
Collapse
Affiliation(s)
- Georg Gosztonyi
- Institute of Neuropathology, Charité, University Medicine Berlin, 10117, Berlin, Germany.
| | - Hanns Ludwig
- Freelance Bornavirus Workgroup, 14163, Berlin, Germany
| | - Liv Bode
- Freelance Bornavirus Workgroup, 14163, Berlin, Germany
| | - Moujahed Kao
- Landesbetrieb Hessisches Landeslabor, 35392, Giessen, Germany
| | - Manfred Sell
- Division of Pathology, Martin Luther Hospital, 12351, Berlin, Germany
| | - Peter Petrusz
- Department of Cell and Developmental Biology, University of North Carolina At Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Béla Halász
- Neuromorphological and Neuroendocrine Research Laboratory, Semmelweis University, 1094, Budapest, Hungary
| |
Collapse
|
17
|
Little DF, Snyder JS, Elhilali M. Ensemble modeling of auditory streaming reveals potential sources of bistability across the perceptual hierarchy. PLoS Comput Biol 2020; 16:e1007746. [PMID: 32275706 PMCID: PMC7185718 DOI: 10.1371/journal.pcbi.1007746] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2019] [Revised: 04/27/2020] [Accepted: 02/25/2020] [Indexed: 11/19/2022] Open
Abstract
Perceptual bistability-the spontaneous, irregular fluctuation of perception between two interpretations of a stimulus-occurs when observing a large variety of ambiguous stimulus configurations. This phenomenon has the potential to serve as a tool for, among other things, understanding how function varies across individuals due to the large individual differences that manifest during perceptual bistability. Yet it remains difficult to interpret the functional processes at work, without knowing where bistability arises during perception. In this study we explore the hypothesis that bistability originates from multiple sources distributed across the perceptual hierarchy. We develop a hierarchical model of auditory processing comprised of three distinct levels: a Peripheral, tonotopic analysis, a Central analysis computing features found more centrally in the auditory system, and an Object analysis, where sounds are segmented into different streams. We model bistable perception within this system by applying adaptation, inhibition and noise into one or all of the three levels of the hierarchy. We evaluate a large ensemble of variations of this hierarchical model, where each model has a different configuration of adaptation, inhibition and noise. This approach avoids the assumption that a single configuration must be invoked to explain the data. Each model is evaluated based on its ability to replicate two hallmarks of bistability during auditory streaming: the selectivity of bistability to specific stimulus configurations, and the characteristic log-normal pattern of perceptual switches. Consistent with a distributed origin, a broad range of model parameters across this hierarchy lead to a plausible form of perceptual bistability.
Collapse
Affiliation(s)
- David F. Little
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, Maryland, United States of America
| | - Joel S. Snyder
- Department of Psychology, University of Nevada, Las Vegas; Las Vegas, Nevada, United States of America
| | - Mounya Elhilali
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, Maryland, United States of America
| |
Collapse
|
18
|
Neural correlates of perceptual switching while listening to bistable auditory streaming stimuli. Neuroimage 2020; 204:116220. [DOI: 10.1016/j.neuroimage.2019.116220] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2019] [Revised: 08/19/2019] [Accepted: 09/19/2019] [Indexed: 11/15/2022] Open
|
19
|
Einhäuser W, da Silva LFO, Bendixen A. Intraindividual Consistency Between Auditory and Visual Multistability. Perception 2020; 49:119-138. [PMID: 31888418 DOI: 10.1177/0301006619896282] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
We compared perceptual multistability across modalities, using a visual plaid pattern (composed of two transparently overlaid drifting gratings) and auditory streaming (elicited by a repeating “ABA_” tone sequence). Both stimuli can be perceived as integrated (one plaid pattern, one stream comprising “A” and “B” tones) or segregated (two individual gratings, two tone streams). In the segregated case, either stream or grating can be perceived in the foreground. We queried auditory and visual perception with these three response options. We found that perceptual dominance of the integrated states was correlated across modalities: Participants who were more likely to perceive the plaid were also more likely to perceive the integrated auditory stream. When presenting both stimuli simultaneously and querying the auditory percept, eye-movement data showed that perceiving auditory and visual integration is related on a moment-by-moment basis. This suggests that in part common mechanisms underlie multistability in visual and auditory perception.
Collapse
Affiliation(s)
- Wolfgang Einhäuser
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Germany
| | - Lucas F O da Silva
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Germany; Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Germany
| | - Alexandra Bendixen
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Germany
| |
Collapse
|
20
|
Pastukhov A, Kastrup P, Abs IF, Carbon CC. Switch rates for orthogonally oriented kinetic-depth displays are correlated across observers. J Vis 2019; 19:1. [PMID: 31157826 DOI: 10.1167/19.6.1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
When continuously viewing multistable displays, which are compatible with several comparably likely interpretations, perception perpetually switches between available alternatives. Prior studies typically report the lack of consistent individual switch rates across different displays. However, this comparison is based on an assumption that neural representations of physically identical displays are consistent across observers. Yet, given how different individuals are already at the level of the retina, it is likely that the difference in other relevant factors might mask the correlation. To address this issue, we compared switch rates in two kinetic-depth displays (KDE) that rotated around orthogonal axes (45° counterclockwise vs. 45° clockwise relative to the vertical). This ensured that dynamics of multistable perception was based on highly similar, but different and independent neural representations. We also included a Necker cube (NC) display as a control. We report that switch rates were correlated between two kinetic-depth effect displays, but not between either of the KDE and NC displays. This demonstrates that the usual lack of correlation may not be evidence for the lack of a shared pacesetter mechanism of multistable perception, but reflect other factors, such as differently modulated inputs to competing representations. In addition, we asked participants to speed-up or slow-down perceptual alternations and found that only the former ability was correlated across different displays. This indicates that these two types of volitional control may differ in their use of attentional resources.
Collapse
Affiliation(s)
- Alexander Pastukhov
- Department of General Psychology and Methodology, University of Bamberg, Bamberg, Bavaria, Germany.,Forschungsgruppe EPÆG (Ergonomics, Psychological Æsthetics, Gestalt), Bamberg, Bavaria, Germany
| | - Philipp Kastrup
- Department of General Psychology and Methodology, University of Bamberg, Bamberg, Bavaria, Germany
| | - Isabel Friederike Abs
- Department of General Psychology and Methodology, University of Bamberg, Bamberg, Bavaria, Germany
| | - Claus-Christian Carbon
- Department of General Psychology and Methodology, University of Bamberg, Bamberg, Bavaria, Germany.,Forschungsgruppe EPÆG (Ergonomics, Psychological Æsthetics, Gestalt), Bamberg, Bavaria, Germany
| |
Collapse
|
21
|
Auditory streaming and bistability paradigm extended to a dynamic environment. Hear Res 2019; 383:107807. [PMID: 31622836 DOI: 10.1016/j.heares.2019.107807] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Revised: 09/19/2019] [Accepted: 10/01/2019] [Indexed: 11/23/2022]
Abstract
We explore stream segregation with temporally modulated acoustic features using behavioral experiments and modelling. The auditory streaming paradigm in which alternating high- A and low-frequency tones B appear in a repeating ABA-pattern, has been shown to be perceptually bistable for extended presentations (order of minutes). For a fixed, repeating stimulus, perception spontaneously changes (switches) at random times, every 2-15 s, between an integrated interpretation with a galloping rhythm and segregated streams. Streaming in a natural auditory environment requires segregation of auditory objects with features that evolve over time. With the relatively idealized ABA-triplet paradigm, we explore perceptual switching in a non-static environment by considering slowly and periodically varying stimulus features. Our previously published model captures the dynamics of auditory bistability and predicts here how perceptual switches are entrained, tightly locked to the rising and falling phase of modulation. In psychoacoustic experiments we find that entrainment depends on both the period of modulation and the intrinsic switch characteristics of individual listeners. The extended auditory streaming paradigm with slowly modulated stimulus features presented here will be of significant interest for future imaging and neurophysiology experiments by reducing the need for subjective perceptual reports of ongoing perception.
Collapse
|
22
|
Rankin J, Rinzel J. Computational models of auditory perception from feature extraction to stream segregation and behavior. Curr Opin Neurobiol 2019; 58:46-53. [PMID: 31326723 DOI: 10.1016/j.conb.2019.06.009] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 06/22/2019] [Indexed: 10/26/2022]
Abstract
Audition is by nature dynamic, from brainstem processing on sub-millisecond time scales, to segregating and tracking sound sources with changing features, to the pleasure of listening to music and the satisfaction of getting the beat. We review recent advances from computational models of sound localization, of auditory stream segregation and of beat perception/generation. A wealth of behavioral, electrophysiological and imaging studies shed light on these processes, typically with synthesized sounds having regular temporal structure. Computational models integrate knowledge from different experimental fields and at different levels of description. We advocate a neuromechanistic modeling approach that incorporates knowledge of the auditory system from various fields, that utilizes plausible neural mechanisms, and that bridges our understanding across disciplines.
Collapse
Affiliation(s)
- James Rankin
- College of Engineering, Mathematics and Physical Sciences, University of Exeter, Harrison Building, North Park Rd, Exeter EX4 4QF, UK.
| | - John Rinzel
- Center for Neural Science, New York University, 4 Washington Place, 10003 New York, NY, United States; Courant Institute of Mathematical Sciences, New York University, 251 Mercer St, 10012 New York, NY, United States
| |
Collapse
|
23
|
Paredes-Gallardo A, Dau T, Marozeau J. Auditory Stream Segregation Can Be Modeled by Neural Competition in Cochlear Implant Listeners. Front Comput Neurosci 2019; 13:42. [PMID: 31333438 PMCID: PMC6616076 DOI: 10.3389/fncom.2019.00042] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Accepted: 06/17/2019] [Indexed: 11/13/2022] Open
Abstract
Auditory stream segregation is a perceptual process by which the human auditory system groups sounds from different sources into perceptually meaningful elements (e.g., a voice or a melody). The perceptual segregation of sounds is important, for example, for the understanding of speech in noisy scenarios, a particularly challenging task for listeners with a cochlear implant (CI). It has been suggested that some aspects of stream segregation may be explained by relatively basic neural mechanisms at a cortical level. During the past decades, a variety of models have been proposed to account for the data from stream segregation experiments in normal-hearing (NH) listeners. However, little attention has been given to corresponding findings in CI listeners. The present study investigated whether a neural model of sequential stream segregation, proposed to describe the behavioral effects observed in NH listeners, can account for behavioral data from CI listeners. The model operates on the stimulus features at the cortical level and includes a competition stage between the neuronal units encoding the different percepts. The competition arises from a combination of mutual inhibition, adaptation, and additive noise. The model was found to capture the main trends in the behavioral data from CI listeners, such as the larger probability of a segregated percept with increasing the feature difference between the sounds as well as the build-up effect. Importantly, this was achieved without any modification to the model's competition stage, suggesting that stream segregation could be mediated by a similar mechanism in both groups of listeners.
Collapse
Affiliation(s)
- Andreu Paredes-Gallardo
- Hearing Systems Section, Department of Health Technology, Technical University of Denmark, Lyngby, Denmark
| | - Torsten Dau
- Hearing Systems Section, Department of Health Technology, Technical University of Denmark, Lyngby, Denmark
| | - Jeremy Marozeau
- Hearing Systems Section, Department of Health Technology, Technical University of Denmark, Lyngby, Denmark
| |
Collapse
|
24
|
Abuleil D, McCulloch DL, Thompson B. Older Adults Exhibit Greater Visual Cortex Inhibition and Reduced Visual Cortex Plasticity Compared to Younger Adults. Front Neurosci 2019; 13:607. [PMID: 31249506 PMCID: PMC6582629 DOI: 10.3389/fnins.2019.00607] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Accepted: 05/27/2019] [Indexed: 12/14/2022] Open
Abstract
Recent evidence indicates that inhibition within the visual cortex is greater in older than young adults. Increased inhibition has been associated with reduced visual cortex plasticity in animal models. We investigated whether age-related increases in human visual cortex inhibition occur in conjunction with reduced visual cortex plasticity. Visual cortex inhibition was measured psychophysically using binocular rivalry alternation rates (AR) for dichoptic gratings. Slower ARs are associated with a greater concentration of the inhibitory neurotransmitter GABA within the human visual cortex. Visual cortex plasticity was measured using an established paradigm for induction of long-term potentiation (LTP) -like increases in visually evoked potential (VEP) amplitude. Following rapid visual stimulation, greater increases in VEP amplitude indicate greater visual cortex plasticity. The study involved two groups; young (18-40 years, n = 29) and older adults (60-80 years, n = 18). VEPs were recorded for a 1 Hz onset/offset checkerboard stimulus before and after 9 Hz visual stimulation with the same stimulus. ARs were slower in older than young adults. In contrast to most previous studies, VEP amplitudes were significantly reduced following the rapid visual stimulation for young adults; older adult VEP amplitudes were unaffected. Our AR results replicate previous observations of increased visual cortex inhibition in the older adults. Rapid visual stimulation significantly altered VEP amplitude in young adults, albeit in the opposite direction than predicted. VEP amplitudes did not change in older adults suggesting an association between increased inhibition and reduced plasticity within the human visual cortex.
Collapse
Affiliation(s)
- Dania Abuleil
- School of Optometry and Vision Science, University of Waterloo, Waterloo, ON, Canada
| | | | | |
Collapse
|