1
|
Berthault E, Chen S, Falk S, Morillon B, Schön D. Auditory and motor priming of metric structure improves understanding of degraded speech. Cognition 2024; 248:105793. [PMID: 38636164 DOI: 10.1016/j.cognition.2024.105793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 03/07/2024] [Accepted: 04/09/2024] [Indexed: 04/20/2024]
Abstract
Speech comprehension is enhanced when preceded (or accompanied) by a congruent rhythmic prime reflecting the metrical sentence structure. Although these phenomena have been described for auditory and motor primes separately, their respective and synergistic contribution has not been addressed. In this experiment, participants performed a speech comprehension task on degraded speech signals that were preceded by a rhythmic prime that could be auditory, motor or audiomotor. Both auditory and audiomotor rhythmic primes facilitated speech comprehension speed. While the presence of a purely motor prime (unpaced tapping) did not globally benefit speech comprehension, comprehension accuracy scaled with the regularity of motor tapping. In order to investigate inter-individual variability, participants also performed a Spontaneous Speech Synchronization test. The strength of the estimated perception-production coupling correlated positively with overall speech comprehension scores. These findings are discussed in the framework of the dynamic attending and active sensing theories.
Collapse
Affiliation(s)
- Emma Berthault
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des Systèmes, Marseille, France.
| | - Sophie Chen
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des Systèmes, Marseille, France.
| | - Simone Falk
- Department of Linguistics and Translation, University of Montreal, Canada; International Laboratory for Brain, Music and Sound Research, Montreal, Canada.
| | - Benjamin Morillon
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des Systèmes, Marseille, France.
| | - Daniele Schön
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des Systèmes, Marseille, France.
| |
Collapse
|
2
|
Zalta A, Large EW, Schön D, Morillon B. Neural dynamics of predictive timing and motor engagement in music listening. SCIENCE ADVANCES 2024; 10:eadi2525. [PMID: 38446888 PMCID: PMC10917349 DOI: 10.1126/sciadv.adi2525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 01/30/2024] [Indexed: 03/08/2024]
Abstract
Why do humans spontaneously dance to music? To test the hypothesis that motor dynamics reflect predictive timing during music listening, we created melodies with varying degrees of rhythmic predictability (syncopation) and asked participants to rate their wanting-to-move (groove) experience. Degree of syncopation and groove ratings are quadratically correlated. Magnetoencephalography data showed that, while auditory regions track the rhythm of melodies, beat-related 2-hertz activity and neural dynamics at delta (1.4 hertz) and beta (20 to 30 hertz) rates in the dorsal auditory pathway code for the experience of groove. Critically, the left sensorimotor cortex coordinates these groove-related delta and beta activities. These findings align with the predictions of a neurodynamic model, suggesting that oscillatory motor engagement during music listening reflects predictive timing and is effected by interaction of neural dynamics along the dorsal auditory pathway.
Collapse
Affiliation(s)
- Arnaud Zalta
- Aix Marseille Université, Inserm, INS, Institut de Neurosciences des Systèmes, Marseille, France
- APHM, INSERM, Inst Neurosci Syst, Service de Pharmacologie Clinique et Pharmacovigilance, Aix Marseille Université, Marseille, France
| | - Edward W. Large
- Department of Psychological Sciences, Ecological Psychology Division, University of Connecticut, Storrs, CT, USA
- Department of Physics, University of Connecticut, Storrs, CT, USA
| | - Daniele Schön
- Aix Marseille Université, Inserm, INS, Institut de Neurosciences des Systèmes, Marseille, France
| | - Benjamin Morillon
- Aix Marseille Université, Inserm, INS, Institut de Neurosciences des Systèmes, Marseille, France
| |
Collapse
|
3
|
Pando-Naude V, Matthews TE, Højlund A, Jakobsen S, Østergaard K, Johnsen E, Garza-Villarreal EA, Witek MAG, Penhune V, Vuust P. Dopamine dysregulation in Parkinson's disease flattens the pleasurable urge to move to musical rhythms. Eur J Neurosci 2024; 59:101-118. [PMID: 37724707 DOI: 10.1111/ejn.16128] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/12/2023] [Accepted: 08/08/2023] [Indexed: 09/21/2023]
Abstract
The pleasurable urge to move to music (PLUMM) activates motor and reward areas of the brain and is thought to be driven by predictive processes. Dopamine in motor and limbic networks is implicated in beat-based timing and music-induced pleasure, suggesting a central role of basal ganglia (BG) dopaminergic systems in PLUMM. This study tested this hypothesis by comparing PLUMM in participants with Parkinson's disease (PD), age-matched controls, and young controls. Participants listened to musical sequences with varying rhythmic and harmonic complexity (low, medium and high), and rated their experienced pleasure and urge to move to the rhythm. In line with previous results, healthy younger participants showed an inverted U-shaped relationship between rhythmic complexity and ratings, with preference for medium complexity rhythms, while age-matched controls showed a similar, but weaker, inverted U-shaped response. Conversely, PD showed a significantly flattened response for both the urge to move and pleasure. Crucially, this flattened response could not be attributed to differences in rhythm discrimination and did not reflect an overall decrease in ratings. For harmonic complexity, PD showed a negative linear pattern for both the urge to move and pleasure while healthy age-matched controls showed the same pattern for pleasure and an inverted U for the urge to move. This contrasts with the pattern observed in young healthy controls in previous studies, suggesting that both healthy aging and PD also influence affective responses to harmonic complexity. Together, these results support the role of dopamine within cortico-striatal circuits in the predictive processes that form the link between the perceptual processing of rhythmic patterns and the affective and motor responses to rhythmic music.
Collapse
Affiliation(s)
- Victor Pando-Naude
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Tomas Edward Matthews
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Andreas Højlund
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University Hospital, Aarhus, Denmark
- Department of Linguistics, Cognitive Science and Semiotics, School of Communication and Culture, Aarhus University, Aarhus, Denmark
| | - Sebastian Jakobsen
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University Hospital, Aarhus, Denmark
- Department of Linguistics, Cognitive Science and Semiotics, School of Communication and Culture, Aarhus University, Aarhus, Denmark
| | - Karen Østergaard
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University Hospital, Aarhus, Denmark
- Department of Neurology, Aarhus University Hospital, Aarhus, Denmark
- Sano, Private Hospital, Aarhus, Denmark
| | - Erik Johnsen
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University Hospital, Aarhus, Denmark
- Department of Neurology, Aarhus University Hospital, Aarhus, Denmark
| | - Eduardo A Garza-Villarreal
- Instituto de Neurobiología, Universidad Nacional Autónoma de México (UNAM), Juriquilla, Querétaro, Mexico
| | - Maria A G Witek
- Department of Music School of Languages, Cultures, Art History and Music, University of Birmingham, Birmingham, UK
| | - Virginia Penhune
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
4
|
Emmery L, Hackney ME, Kesar T, McKay JL, Rosenberg MC. An integrated review of music cognition and rhythmic stimuli in sensorimotor neurocognition and neurorehabilitation. Ann N Y Acad Sci 2023; 1530:74-86. [PMID: 37917153 PMCID: PMC10841443 DOI: 10.1111/nyas.15079] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
This work reviews the growing body of interdisciplinary research on music cognition, using biomechanical, kinesiological, clinical, psychosocial, and sociological methods. The review primarily examines the relationship between temporal elements in music and motor responses under varying contexts, with considerable relevance for clinical rehabilitation. After providing an overview of the terminology and approaches pertinent to theories of rhythm and meter from the musical-theoretical and cognitive fields, this review focuses on studies on the effects of rhythmic sensory stimulation on gait, rhythmic cues' effect on the motor system, reactions to rhythmic stimuli attempting to synchronize mobility (i.e., musical embodiment), and the application of rhythm for motor rehabilitation for individuals with Parkinson's disease, stroke, mild cognitive impairment, Alzheimer's disease, and other neurodegenerative or neurotraumatic diseases. This work ultimately bridges the gap between the musical-theoretical and cognitive science fields to facilitate innovative research in which each discipline informs the other.
Collapse
Affiliation(s)
- Laura Emmery
- Department of Music, Emory College of Arts and Sciences, Emory University, Atlanta, Georgia, USA
| | - Madeleine E. Hackney
- Center for Visual and Neurocognitive Rehabilitation, Atlanta VA HealthCare System, Decatur, Georgia, USA
- Department of Medicine, Division of Geriatrics and Gerontology, Emory University School of Medicine, Atlanta, Georgia, USA
- Department of Veterans Affairs Birmingham/Atlanta Geriatric Research Education and Clinical Center
- Department of Rehabilitation Medicine, Division of Physical Therapy, Emory University School of Medicine, Atlanta, Georgia, USA
- Emory University School of Nursing, Atlanta, Georgia, USA
| | - Trisha Kesar
- Department of Rehabilitation Medicine, Emory University School of Medicine, Atlanta, Georgia, USA
| | - J. Lucas McKay
- Department of Neurology, Emory University School of Medicine, Atlanta, Georgia, USA
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, Georgia, USA
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, Georgia, USA
| | - Michael C. Rosenberg
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, Georgia, USA
| |
Collapse
|
5
|
Maldonado PE, Concha-Miranda M, Schwalm M. Autogenous cerebral processes: an invitation to look at the brain from inside out. Front Neural Circuits 2023; 17:1253609. [PMID: 37941893 PMCID: PMC10629273 DOI: 10.3389/fncir.2023.1253609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 09/26/2023] [Indexed: 11/10/2023] Open
Abstract
While external stimulation can reliably trigger neuronal activity, cerebral processes can operate independently from the environment. In this study, we conceptualize autogenous cerebral processes (ACPs) as intrinsic operations of the brain that exist on multiple scales and can influence or shape stimulus responses, behavior, homeostasis, and the physiological state of an organism. We further propose that the field should consider exploring to what extent perception, arousal, behavior, or movement, as well as other cognitive functions previously investigated mainly regarding their stimulus-response dynamics, are ACP-driven.
Collapse
Affiliation(s)
- Pedro E. Maldonado
- Departamento de Neurociencia, Facultad de Medicina, Universidad de Chile, Santiago, Chile
- Biomedical Neuroscience Institute (BNI), Faculty of Medicine, University of Chile, Santiago, Chile
- National Center for Artificial Intelligence (CENIA), Santiago, Chile
| | - Miguel Concha-Miranda
- Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Miriam Schwalm
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
6
|
Rosso M, Moens B, Leman M, Moumdjian L. Neural entrainment underpins sensorimotor synchronization to dynamic rhythmic stimuli. Neuroimage 2023; 277:120226. [PMID: 37321359 DOI: 10.1016/j.neuroimage.2023.120226] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 05/02/2023] [Accepted: 06/12/2023] [Indexed: 06/17/2023] Open
Abstract
Neural entrainment, defined as unidirectional synchronization of neural oscillations to an external rhythmic stimulus, is a topic of major interest in the field of neuroscience. Despite broad scientific consensus on its existence, on its pivotal role in sensory and motor processes, and on its fundamental definition, empirical research struggles in quantifying it with non-invasive electrophysiology. To this date, broadly adopted state-of-the-art methods still fail to capture the dynamic underlying the phenomenon. Here, we present event-related frequency adjustment (ERFA) as a methodological framework to induce and to measure neural entrainment in human participants, optimized for multivariate EEG datasets. By applying dynamic phase and tempo perturbations to isochronous auditory metronomes during a finger-tapping task, we analyzed adaptive changes in instantaneous frequency of entrained oscillatory components during error correction. Spatial filter design allowed us to untangle, from the multivariate EEG signal, perceptual and sensorimotor oscillatory components attuned to the stimulation frequency. Both components dynamically adjusted their frequency in response to perturbations, tracking the stimulus dynamics by slowing down and speeding up the oscillation over time. Source separation revealed that sensorimotor processing enhanced the entrained response, supporting the notion that the active engagement of the motor system plays a critical role in processing rhythmic stimuli. In the case of phase shift, motor engagement was a necessary condition to observe any response, whereas sustained tempo changes induced frequency adjustment even in the perceptual oscillatory component. Although the magnitude of the perturbations was controlled across positive and negative direction, we observed a general bias in the frequency adjustments towards positive changes, which points at the effect of intrinsic dynamics constraining neural entrainment. We conclude that our findings provide compelling evidence for neural entrainment as mechanism underlying overt sensorimotor synchronization, and highlight that our methodology offers a paradigm and a measure for quantifying its oscillatory dynamics by means of non-invasive electrophysiology, rigorously informed by the fundamental definition of entrainment.
Collapse
Affiliation(s)
- Mattia Rosso
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium; Université de Lille, ULR 4072 - PSITEC - Psychologie: Interactions, Temps, Emotions, Cognition, Lille, France.
| | - Bart Moens
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium
| | - Marc Leman
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium
| | - Lousin Moumdjian
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium; REVAL Rehabilitation Research Center, Faculty of Rehabilitation Sciences, Hasselt University, Hasselt, Belgium; UMSC Hasselt, Pelt, Belgium
| |
Collapse
|
7
|
Kral A, Sharma A. Crossmodal plasticity in hearing loss. Trends Neurosci 2023; 46:377-393. [PMID: 36990952 PMCID: PMC10121905 DOI: 10.1016/j.tins.2023.02.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 01/27/2023] [Accepted: 02/21/2023] [Indexed: 03/29/2023]
Abstract
Crossmodal plasticity is a textbook example of the ability of the brain to reorganize based on use. We review evidence from the auditory system showing that such reorganization has significant limits, is dependent on pre-existing circuitry and top-down interactions, and that extensive reorganization is often absent. We argue that the evidence does not support the hypothesis that crossmodal reorganization is responsible for closing critical periods in deafness, and crossmodal plasticity instead represents a neuronal process that is dynamically adaptable. We evaluate the evidence for crossmodal changes in both developmental and adult-onset deafness, which start as early as mild-moderate hearing loss and show reversibility when hearing is restored. Finally, crossmodal plasticity does not appear to affect the neuronal preconditions for successful hearing restoration. Given its dynamic and versatile nature, we describe how this plasticity can be exploited for improving clinical outcomes after neurosensory restoration.
Collapse
Affiliation(s)
- Andrej Kral
- Institute of AudioNeuroTechnology and Department of Experimental Otology, Otolaryngology Clinics, Hannover Medical School, Hannover, Germany; Australian Hearing Hub, School of Medicine and Health Sciences, Macquarie University, Sydney, NSW, Australia
| | - Anu Sharma
- Department of Speech Language and Hearing Science, Center for Neuroscience, Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA.
| |
Collapse
|
8
|
Rhythmic tapping difficulties in adults who stutter: A deficit in beat perception, motor execution, or sensorimotor integration? PLoS One 2023; 18:e0276691. [PMID: 36735662 PMCID: PMC9897587 DOI: 10.1371/journal.pone.0276691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 10/11/2022] [Indexed: 02/04/2023] Open
Abstract
OBJECTIVES The study aims to better understand the rhythmic abilities of people who stutter and to identify which processes potentially are impaired in this population: (1) beat perception and reproduction; (2) the execution of movements, in particular their initiation; (3) sensorimotor integration. MATERIAL AND METHOD Finger tapping behavior of 16 adults who stutter (PWS) was compared with that of 16 matching controls (PNS) in five rhythmic tasks of various complexity: three synchronization tasks - a simple 1:1 isochronous pattern, a complex non-isochronous pattern, and a 4 tap:1 beat isochronous pattern -, a reaction task to an aperiodic and unpredictable pattern, and a reproduction task of an isochronous pattern after passively listening. RESULTS PWS were able to reproduce an isochronous pattern on their own, without external auditory stimuli, with similar accuracy as PNS, but with increased variability. This group difference in variability was observed immediately after passive listening, without prior motor engagement, and was not enhanced or reduced after several seconds of tapping. Although PWS showed increased tapping variability in the reproduction task as well as in synchronization tasks, this timing variability did not correlate significantly with the variability in reaction times or tapping force. Compared to PNS, PWS exhibited larger negative mean asynchronies, and increased synchronization variability in synchronization tasks. These group differences were not affected by beat hierarchy (i.e., "strong" vs. "weak" beats), pattern complexity (non-isochronous vs. isochronous) or presence versus absence of external auditory stimulus (1:1 vs. 1:4 isochronous pattern). Differences between PWS and PNS were not enhanced or reduced with sensorimotor learning, over the first taps of a synchronization task. CONCLUSION Our observations support the hypothesis of a deficit in neuronal oscillators coupling in production, but not in perception, of rhythmic patterns, and a larger delay in multi-modal feedback processing for PWS.
Collapse
|
9
|
Kim HW, Lee KM, Lee YS. Sensorimotor and working memory systems jointly support development of perceptual rhythm processing. Dev Sci 2023; 26:e13261. [PMID: 35343637 DOI: 10.1111/desc.13261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Revised: 02/07/2022] [Accepted: 03/12/2022] [Indexed: 12/15/2022]
Abstract
We studied the role of sensorimotor and working memory systems in supporting development of perceptual rhythm processing with 119 participants aged 7-12 years. Children were assessed for their abilities in sensorimotor synchronization (SMS; beat tapping), auditory working memory (AWM; digit span), and rhythm discrimination (RD; same/different judgment on a pair of musical rhythm sequences). Multiple regression analysis revealed that children's RD performance was independently predicted by higher beat tapping consistency and greater digit span score, with all other demographic variables (age, sex, socioeconomic status, music training) controlled. The association between RD and SMS was more robust in the slower tempos (60 and 100 beats-per-minute (BPM)) than faster ones (120 and 180 BPM). Critically, the relation of SMS to RD was moderated by age in that RD performance was predicted by beat tapping consistency in younger children (age: 7-9 years), but not in older children (age: 10-12 years). AWM was the only predictor of RD in older children. Together, the current findings demonstrate that the sensorimotor and working memory systems jointly support RD processing during middle-to-late childhood and that the degree of association between the two systems and perceptual rhythm processing is shifted before entering into early adolescence.
Collapse
Affiliation(s)
- Hyun-Woong Kim
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, USA.,Department of Psychology, The University of Texas at Dallas, Richardson, Texas, USA.,Callier Center for Communication Disorders, The University of Texas at Dallas, Richardson, Texas, USA
| | - Kyung Myun Lee
- School of Humanities and Social Sciences, Korea Advanced Institute of Science and Technology, Daejeon, South Korea.,Graduate School of Culture Technology, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - Yune Sang Lee
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, USA.,Callier Center for Communication Disorders, The University of Texas at Dallas, Richardson, Texas, USA.,Department of Speech, Language, and Hearing, The University of Texas at Dallas, Richardson, Texas, USA
| |
Collapse
|
10
|
Cross-modal attentional effects of rhythmic sensory stimulation. Atten Percept Psychophys 2022; 85:863-878. [PMID: 36385670 PMCID: PMC10066103 DOI: 10.3758/s13414-022-02611-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2022] [Indexed: 11/18/2022]
Abstract
AbstractTemporal regularities are ubiquitous in our environment. The theory of entrainment posits that the brain can utilize these regularities by synchronizing neural activity with external events, thereby, aligning moments of high neural excitability with expected upcoming stimuli and facilitating perception. Despite numerous accounts reporting entrainment of behavioural and electrophysiological measures, evidence regarding this phenomenon remains mixed, with several recent studies having failed to provide confirmatory evidence. Notably, it is currently unclear whether and for how long the effects of entrainment can persist beyond their initiating stimulus, and whether they remain restricted to the stimulated sensory modality or can cross over to other modalities. Here, we set out to answer these questions by presenting participants with either visual or auditory rhythmic sensory stimulation, followed by a visual or auditory target at six possible time points, either in-phase or out-of-phase relative to the initial stimulus train. Unexpectedly, but in line with several recent studies, we observed no evidence for cyclic fluctuations in performance, despite our design being highly similar to those used in previous demonstrations of sensory entrainment. However, our data revealed a temporally less specific attentional effect, via cross-modally facilitated performance following auditory compared with visual rhythmic stimulation. In addition to a potentially higher salience of auditory rhythms, this could indicate an effect on oscillatory 3-Hz amplitude, resulting in facilitated cognitive control and attention. In summary, our study further challenges the generality of periodic behavioural modulation associated with sensory entrainment, while demonstrating a modality-independent attention effect following auditory rhythmic stimulation.
Collapse
|
11
|
Listeners are sensitive to the speech breathing time series: Evidence from a gap detection task. Cognition 2022; 225:105171. [DOI: 10.1016/j.cognition.2022.105171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 04/29/2022] [Accepted: 05/11/2022] [Indexed: 11/23/2022]
|
12
|
Latency shortening with enhanced sparseness and responsiveness in V1 during active visual sensing. Sci Rep 2022; 12:6021. [PMID: 35410997 PMCID: PMC9001710 DOI: 10.1038/s41598-022-09405-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 03/21/2022] [Indexed: 12/03/2022] Open
Abstract
In natural vision, neuronal responses to visual stimuli occur due to self-initiated eye movements. Here, we compare single-unit activity in the primary visual cortex (V1) of non-human primates to flashed natural scenes (passive vision condition) to when they freely explore the images by self-initiated eye movements (active vision condition). Active vision enhances the number of neurons responding, and the response latencies become shorter and less variable across neurons. The increased responsiveness and shortened latency during active vision were not explained by increased visual contrast. While the neuronal activities in all layers of V1 show enhanced responsiveness and shortened latency, a significant increase in lifetime sparseness during active vision is observed only in the supragranular layer. These findings demonstrate that the neuronal responses become more distinct in active vision than passive vision, interpreted as consequences of top-down predictive mechanisms.
Collapse
|
13
|
Wu J, Zhang L, Yang H, Lu C, Jiang L, Chen Y. The Effect of Music Tempo on Fatigue Perception at Different Exercise Intensities. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19073869. [PMID: 35409552 PMCID: PMC8997730 DOI: 10.3390/ijerph19073869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 03/20/2022] [Accepted: 03/22/2022] [Indexed: 12/04/2022]
Abstract
Background: This study aimed to clarify the effect of music tempo on runners’ perception of fatigue at different exercise intensities and while listening to music of different tempos through running experiments. Methods: This study used a within-subject two-factor experimental design with music tempo (fast music, slow music, no music) and exercise intensity (high intensity, low intensity) as independent variables and the time to fatigue perception (TFP), the difference in heart rate (HR) and the difference in the median frequency (MF) of surface electromyography (sEMG) signals as observation indexes. Eighteen participants completed a total of 108 sets of running experiments. Results: (1) The main effect of music tempo on the TFP was significant (p < 0.001). (2) The main effect of exercise intensity on the TFP was significant (p < 0.001), and the main effect on the difference in HR was significant (p < 0.001). (3) The interaction effect of music tempo and exercise intensity on the TFP was significant (p < 0.05). Conclusions: Exercisers’ subjective perception of fatigue was affected by music tempo and the interaction between music tempo and exercise intensity, and exercisers’ objective fatigue perception was influenced mostly by exercise intensity. The findings of this study provide guidance for runners’ choice of music at different intensities of exercise. Whether it is low-intensity exercise or high-intensity exercise, listening to fast music while exercising can help runners perform better mentally and physically during their runs.
Collapse
Affiliation(s)
- Jianfeng Wu
- Industrial Design and Research Institute, Zhejiang University of Technology, Hangzhou 310023, China; (J.W.); (H.Y.)
| | - Lingyan Zhang
- School of Design and Architecture, Zhejiang University of Technology, Hangzhou 310023, China; (L.Z.); (L.J.); (Y.C.)
| | - Hongchun Yang
- Industrial Design and Research Institute, Zhejiang University of Technology, Hangzhou 310023, China; (J.W.); (H.Y.)
| | - Chunfu Lu
- Industrial Design and Research Institute, Zhejiang University of Technology, Hangzhou 310023, China; (J.W.); (H.Y.)
- Correspondence:
| | - Lu Jiang
- School of Design and Architecture, Zhejiang University of Technology, Hangzhou 310023, China; (L.Z.); (L.J.); (Y.C.)
| | - Yuyun Chen
- School of Design and Architecture, Zhejiang University of Technology, Hangzhou 310023, China; (L.Z.); (L.J.); (Y.C.)
| |
Collapse
|
14
|
Fiveash A, Burger B, Canette LH, Bedoin N, Tillmann B. When Visual Cues Do Not Help the Beat: Evidence for a Detrimental Effect of Moving Point-Light Figures on Rhythmic Priming. Front Psychol 2022; 13:807987. [PMID: 35185727 PMCID: PMC8855071 DOI: 10.3389/fpsyg.2022.807987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 01/10/2022] [Indexed: 11/13/2022] Open
Abstract
Rhythm perception involves strong auditory-motor connections that can be enhanced with movement. However, it is unclear whether just seeing someone moving to a rhythm can enhance auditory-motor coupling, resulting in stronger entrainment. Rhythmic priming studies show that presenting regular rhythms before naturally spoken sentences can enhance grammaticality judgments compared to irregular rhythms or other baseline conditions. The current study investigated whether introducing a point-light figure moving in time with regular rhythms could enhance the rhythmic priming effect. Three experiments revealed that the addition of a visual cue did not benefit rhythmic priming in comparison to auditory conditions with a static image. In Experiment 1 (27 7–8-year-old children), grammaticality judgments were poorer after audio-visual regular rhythms (with a bouncing point-light figure) compared to auditory-only regular rhythms. In Experiments 2 (31 adults) and 3 (31 different adults), there was no difference in grammaticality judgments after audio-visual regular rhythms compared to auditory-only irregular rhythms for either a bouncing point-light figure (Experiment 2) or a swaying point-light figure (Experiment 3). Comparison of the observed performance with previous data suggested that the audio-visual component removed the regular prime benefit. These findings suggest that the visual cues used in this study do not enhance rhythmic priming and could hinder the effect by potentially creating a dual-task situation. In addition, individual differences in sensory-motor and social scales of music reward influenced the effect of the visual cue. Implications for future audio-visual experiments aiming to enhance beat processing, and the importance of individual differences will be discussed.
Collapse
Affiliation(s)
- Anna Fiveash
- Lyon Neuroscience Research Center, CNRS, UMR 5292, INSERM, U1028, Lyon, France
- University of Lyon 1, Lyon, France
- *Correspondence: Anna Fiveash,
| | - Birgitta Burger
- Institute for Systematic Musicology, University of Hamburg, Hamburg, Germany
| | - Laure-Hélène Canette
- Lyon Neuroscience Research Center, CNRS, UMR 5292, INSERM, U1028, Lyon, France
- University of Lyon 1, Lyon, France
- University of Burgundy, F-21000, LEAD-CNRS UMR 5022, Dijon, France
| | - Nathalie Bedoin
- Lyon Neuroscience Research Center, CNRS, UMR 5292, INSERM, U1028, Lyon, France
- University of Lyon 1, Lyon, France
- University of Lyon 2, Lyon, France
| | - Barbara Tillmann
- Lyon Neuroscience Research Center, CNRS, UMR 5292, INSERM, U1028, Lyon, France
- University of Lyon 1, Lyon, France
| |
Collapse
|
15
|
Cheng THZ, Creel SC, Iversen JR. How Do You Feel the Rhythm: Dynamic Motor-Auditory Interactions Are Involved in the Imagination of Hierarchical Timing. J Neurosci 2022; 42:500-512. [PMID: 34848500 PMCID: PMC8802922 DOI: 10.1523/jneurosci.1121-21.2021] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 11/10/2021] [Accepted: 11/12/2021] [Indexed: 11/21/2022] Open
Abstract
Predicting and organizing patterns of events is important for humans to survive in a dynamically changing world. The motor system has been proposed to be actively, and necessarily, engaged in not only the production but the perception of rhythm by organizing hierarchical timing that influences auditory responses. It is not yet well understood how the motor system interacts with the auditory system to perceive and maintain hierarchical structure in time. This study investigated the dynamic interaction between auditory and motor functional sources during the perception and imagination of musical meters. We pursued this using a novel method combining high-density EEG, EMG, and motion capture with independent component analysis to separate motor and auditory activity during meter imagery while robustly controlling against covert movement. We demonstrated that endogenous brain activity in both auditory and motor functional sources reflects the imagination of binary and ternary meters in the absence of corresponding acoustic cues or overt movement at the meter rate. We found clear evidence for hypothesized motor-to-auditory information flow at the beat rate in all conditions, suggesting a role for top-down influence of the motor system on auditory processing of beat-based rhythms, and reflecting an auditory-motor system with tight reciprocal informational coupling. These findings align with and further extend a set of motor hypotheses from beat perception to hierarchical meter imagination, adding supporting evidence to active engagement of the motor system in auditory processing, which may more broadly speak to the neural mechanisms of temporal processing in other human cognitive functions.SIGNIFICANCE STATEMENT Humans live in a world full of hierarchically structured temporal information, the accurate perception of which is essential for understanding speech and music. Music provides a window into the brain mechanisms of time perception, enabling us to examine how the brain groups musical beats into, for example a march or waltz. Using a novel paradigm combining measurement of electrical brain activity with data-driven analysis, this study directly investigates motor-auditory connectivity during meter imagination. Findings highlight the importance of the motor system in the active imagination of meter. This study sheds new light on a fundamental form of perception by demonstrating how auditory-motor interaction may support hierarchical timing processing, which may have clinical implications for speech and motor rehabilitation.
Collapse
Affiliation(s)
- Tzu-Han Zoe Cheng
- Department of Cognitive Science, University of California-San Diego, La Jolla, California 92093
- Institute for Neural Computation and Swartz Center for Computational Neuroscience, University of California-San Diego, La Jolla, California 92093
| | - Sarah C Creel
- Department of Cognitive Science, University of California-San Diego, La Jolla, California 92093
| | - John R Iversen
- Institute for Neural Computation and Swartz Center for Computational Neuroscience, University of California-San Diego, La Jolla, California 92093
| |
Collapse
|
16
|
Kluger DS, Balestrieri E, Busch NA, Gross J. Respiration aligns perception with neural excitability. eLife 2021; 10:e70907. [PMID: 34904567 PMCID: PMC8763394 DOI: 10.7554/elife.70907] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 12/13/2021] [Indexed: 11/23/2022] Open
Abstract
Recent studies from the field of interoception have highlighted the link between bodily and neural rhythms during action, perception, and cognition. The mechanisms underlying functional body-brain coupling, however, are poorly understood, as are the ways in which they modulate behavior. We acquired respiration and human magnetoencephalography data from a near-threshold spatial detection task to investigate the trivariate relationship between respiration, neural excitability, and performance. Respiration was found to significantly modulate perceptual sensitivity as well as posterior alpha power (8-13 Hz), a well-established proxy of cortical excitability. In turn, alpha suppression prior to detected versus undetected targets underscored the behavioral benefits of heightened excitability. Notably, respiration-locked excitability changes were maximized at a respiration phase lag of around -30° and thus temporally preceded performance changes. In line with interoceptive inference accounts, these results suggest that respiration actively aligns sampling of sensory information with transient cycles of heightened excitability to facilitate performance.
Collapse
Affiliation(s)
- Daniel S Kluger
- Institute for Biomagnetism and Biosignal Analysis, University of MünsterMünsterGermany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of MünsterMünsterGermany
| | - Elio Balestrieri
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of MünsterMünsterGermany
- Institute of Psychology, University of MünsterMünsterGermany
| | - Niko A Busch
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of MünsterMünsterGermany
- Institute of Psychology, University of MünsterMünsterGermany
| | - Joachim Gross
- Institute for Biomagnetism and Biosignal Analysis, University of MünsterMünsterGermany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of MünsterMünsterGermany
- Centre for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of GlasgowGlasgowUnited Kingdom
| |
Collapse
|
17
|
Ogawa T, Shimobayashi H, Hirayama JI, Kawanabe M. Asymmetric directed functional connectivity within the frontoparietal motor network during motor imagery and execution. Neuroimage 2021; 247:118794. [PMID: 34906713 DOI: 10.1016/j.neuroimage.2021.118794] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Revised: 11/12/2021] [Accepted: 12/07/2021] [Indexed: 10/19/2022] Open
Abstract
Both imagery and execution of motor control consist of interactions within a neuronal network, including frontal motor-related and posterior parietal regions. To reveal neural representation in the frontoparietal motor network, two approaches have been proposed thus far: one is decoding of actions/modes related to motor control from the spatial pattern of brain activity; and the other is estimating directed functional connectivity (a directed association between two brain regions within motor areas). However, directed connectivity among multiple regions of the frontoparietal motor network during motor imagery (MI) or motor execution (ME) has not been investigated. Here, we attempted to characterize the directed functional connectivity representing the MI and ME conditions. We developed a delayed sequential movement and imagery task to evoke brain activity associated with ME and MI, which can be recorded by functional magnetic resonance imaging. We applied a causal discovery approach, a linear non-Gaussian acyclic causal model, to identify directed functional connectivity among the frontoparietal motor-related brain regions for each condition. We demonstrated higher directed functional connectivity from the contralateral dorsal premotor cortex (dPMC) to the primary motor cortex (M1) in ME than in MI. We further identified significant direct effects of the dPMC and ventral premotor cortex (vPMC) to the parietal regions. In particular, connectivity from the dPMC to the superior parietal lobule (SPL) in the same hemisphere showed significant positive effects across all conditions, while interlateral connectivities from the vPMC to the SPL showed significantly negative effects across all conditions. Finally, we found positive effects from A1 to M1, that is, the audio-motor pathway, in the same hemisphere. These results indicate that the sources of motor command originating in the d/vPMC influenced the M1 and parietal regions for achieving ME and MI. Additionally, sequential sounds may functionally facilitate temporal motor processes.
Collapse
Affiliation(s)
- Takeshi Ogawa
- Cognitive Mechanisms Laboratories, Advanced Telecommunications Research Institute International, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 618-0288, Japan.
| | - Hideki Shimobayashi
- Cognitive Mechanisms Laboratories, Advanced Telecommunications Research Institute International, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 618-0288, Japan; Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan.
| | - Jun-Ichiro Hirayama
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), AIST Central 2, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8568, Japan; RIKEN Center for Advanced Intelligence Project, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 618-0288, Japan.
| | - Motoaki Kawanabe
- Cognitive Mechanisms Laboratories, Advanced Telecommunications Research Institute International, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 618-0288, Japan; RIKEN Center for Advanced Intelligence Project, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 618-0288, Japan.
| |
Collapse
|
18
|
Fiveash A, Bedoin N, Gordon RL, Tillmann B. Processing rhythm in speech and music: Shared mechanisms and implications for developmental speech and language disorders. Neuropsychology 2021; 35:771-791. [PMID: 34435803 PMCID: PMC8595576 DOI: 10.1037/neu0000766] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
OBJECTIVE Music and speech are complex signals containing regularities in how they unfold in time. Similarities between music and speech/language in terms of their auditory features, rhythmic structure, and hierarchical structure have led to a large body of literature suggesting connections between the two domains. However, the precise underlying mechanisms behind this connection remain to be elucidated. METHOD In this theoretical review article, we synthesize previous research and present a framework of potentially shared neural mechanisms for music and speech rhythm processing. We outline structural similarities of rhythmic signals in music and speech, synthesize prominent music and speech rhythm theories, discuss impaired timing in developmental speech and language disorders, and discuss music rhythm training as an additional, potentially effective therapeutic tool to enhance speech/language processing in these disorders. RESULTS We propose the processing rhythm in speech and music (PRISM) framework, which outlines three underlying mechanisms that appear to be shared across music and speech/language processing: Precise auditory processing, synchronization/entrainment of neural oscillations to external stimuli, and sensorimotor coupling. The goal of this framework is to inform directions for future research that integrate cognitive and biological evidence for relationships between rhythm processing in music and speech. CONCLUSION The current framework can be used as a basis to investigate potential links between observed timing deficits in developmental disorders, impairments in the proposed mechanisms, and pathology-specific deficits which can be targeted in treatment and training supporting speech therapy outcomes. On these grounds, we propose future research directions and discuss implications of our framework. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
- Anna Fiveash
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR5292, INSERM, U1028, F-69000, Lyon, France
- University Lyon 1, Lyon, France
| | - Nathalie Bedoin
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR5292, INSERM, U1028, F-69000, Lyon, France
- University Lyon 1, Lyon, France
- University of Lyon 2, CNRS, UMR5596, Lyon, F-69000, France
| | - Reyna L. Gordon
- Department of Otolaryngology – Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, Tennessee
- Vanderbilt Genetics Institute, Vanderbilt University, Nashville, Tennessee
- Vanderbilt Kennedy Center, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Barbara Tillmann
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR5292, INSERM, U1028, F-69000, Lyon, France
- University Lyon 1, Lyon, France
| |
Collapse
|
19
|
Park JK, Kim SJ. Dual-Task-Based Drum Playing with Rhythmic Cueing on Motor and Attention Control in Patients with Parkinson's Disease: A Preliminary Randomized Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:10095. [PMID: 34639396 PMCID: PMC8508067 DOI: 10.3390/ijerph181910095] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 09/20/2021] [Accepted: 09/23/2021] [Indexed: 12/16/2022]
Abstract
Although there have been increasing reports regarding the effectiveness of dual-task interventions in rehabilitation, the scope of this research is limited to gross motor movement, such as gait among patients with Parkinson's disease (PD). To expand the dual-task paradigm to upper extremity motor and attention control in PD, drum playing with modulation of musical elements was attempted. The objective of this study was to evaluate the effects of a drum playing intervention with rhythmic cueing on upper extremity motor control and attention control in patients with PD. Twelve participants were randomly assigned to the drum playing intervention with rhythmic cueing group or the control group. The results showed that the drum playing with rhythmic cueing (DPRC) group significantly increased their sustained time of entrainment (45 BPM) and their latency time until entrainment from pretest to posttest. For the DPRC group, the latency time until entrainment was significantly improved, and improvements in cognitive measures were also found. This study shows that DPRC has great potential to improve upper extremity motor control and attention control and supports the development of new interventions that include this technique for rehabilitation in patients with PD.
Collapse
Affiliation(s)
- Jin-Kyoung Park
- Music Therapy Education, Graduate School of Education, Ewha Womans University, Seoul 03760, Korea;
- Laboratory of Brain & Cognitive Sciences for Convergence Medicine, Hallym University College of Medicine, Anyang 14068, Korea
| | - Soo Ji Kim
- Music Therapy Education, Graduate School of Education, Ewha Womans University, Seoul 03760, Korea;
| |
Collapse
|
20
|
The influence of auditory rhythms on the speed of inferred motion. Atten Percept Psychophys 2021; 84:2360-2383. [PMID: 34435321 DOI: 10.3758/s13414-021-02364-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/26/2021] [Indexed: 12/24/2022]
Abstract
The present research explored the influence of isochronous auditory rhythms on the timing of movement-related prediction in two experiments. In both experiments, participants observed a moving disc that was visible for a predetermined period before disappearing behind a small, medium, or large occluded area for the remainder of its movement. In Experiment 1, the disc was visible for 1 s. During this period, participants were exposed to either a fast or slow auditory rhythm, or they heard nothing. They were instructed to press a key to indicate when they believed the moving disc had reached a specified location on the other side of the occluded area. The procedure measured the (signed) error in participants' estimate of the time it would take for a moving object to contact a stationary one. The principal results of Experiment 1 were main effects of the rate of the auditory rhythm and of the size of the occlusion on participants' judgments. In Experiment 2, the period of visibility was varied with size of the occlusion area to keep the total movement time constant for all three levels of occlusion. The results replicated the main effect of rhythm found in Experiment 1 and showed a small, significant interaction, but indicated no main effect of occlusion size. Overall, the results indicate that exposure to fast isochronous auditory rhythms during an interval of inferred motion can influence the imagined rate of such motion and suggest a possible role of an internal rhythmicity in the maintenance of temporally accurate dynamic mental representations.
Collapse
|
21
|
Clayton KK, Asokan MM, Watanabe Y, Hancock KE, Polley DB. Behavioral Approaches to Study Top-Down Influences on Active Listening. Front Neurosci 2021; 15:666627. [PMID: 34305516 PMCID: PMC8299106 DOI: 10.3389/fnins.2021.666627] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Accepted: 06/09/2021] [Indexed: 11/21/2022] Open
Abstract
The massive network of descending corticofugal projections has been long-recognized by anatomists, but their functional contributions to sound processing and auditory-guided behaviors remain a mystery. Most efforts to characterize the auditory corticofugal system have been inductive; wherein function is inferred from a few studies employing a wide range of methods to manipulate varying limbs of the descending system in a variety of species and preparations. An alternative approach, which we focus on here, is to first establish auditory-guided behaviors that reflect the contribution of top-down influences on auditory perception. To this end, we postulate that auditory corticofugal systems may contribute to active listening behaviors in which the timing of bottom-up sound cues can be predicted from top-down signals arising from cross-modal cues, temporal integration, or self-initiated movements. Here, we describe a behavioral framework for investigating how auditory perceptual performance is enhanced when subjects can anticipate the timing of upcoming target sounds. Our first paradigm, studied both in human subjects and mice, reports species-specific differences in visually cued expectation of sound onset in a signal-in-noise detection task. A second paradigm performed in mice reveals the benefits of temporal regularity as a perceptual grouping cue when detecting repeating target tones in complex background noise. A final behavioral approach demonstrates significant improvements in frequency discrimination threshold and perceptual sensitivity when auditory targets are presented at a predictable temporal interval following motor self-initiation of the trial. Collectively, these three behavioral approaches identify paradigms to study top-down influences on sound perception that are amenable to head-fixed preparations in genetically tractable animals, where it is possible to monitor and manipulate particular nodes of the descending auditory pathway with unparalleled precision.
Collapse
Affiliation(s)
- Kameron K. Clayton
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear, Boston, MA, United States
| | - Meenakshi M. Asokan
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear, Boston, MA, United States
| | - Yurika Watanabe
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear, Boston, MA, United States
| | - Kenneth E. Hancock
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear, Boston, MA, United States
- Department of Otolaryngology – Head and Neck Surgery, Harvard Medical School, Boston, MA, United States
| | - Daniel B. Polley
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear, Boston, MA, United States
- Department of Otolaryngology – Head and Neck Surgery, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
22
|
Regev M, Halpern AR, Owen AM, Patel AD, Zatorre RJ. Mapping Specific Mental Content during Musical Imagery. Cereb Cortex 2021; 31:3622-3640. [PMID: 33749742 DOI: 10.1093/cercor/bhab036] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Revised: 02/02/2021] [Accepted: 02/05/2021] [Indexed: 11/12/2022] Open
Abstract
Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.
Collapse
Affiliation(s)
- Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.,International Laboratory for Brain, Music and Sound Research, Montreal, QC H2V 2J2, Canada.,Centre for Research in Language, Brain, and Music, Montreal, QC H3A 1E3, Canada
| | - Andrea R Halpern
- Department of Psychology, Bucknell University, Lewisburg, PA 17837, USA
| | - Adrian M Owen
- Brain and Mind Institute, Department of Psychology and Department of Physiology and Pharmacology, Western University, London, ON N6A 5B7, Canada.,Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program
| | - Aniruddh D Patel
- Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program.,Department of Psychology, Tufts University, Medford, MA 02155, USA
| | - Robert J Zatorre
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.,International Laboratory for Brain, Music and Sound Research, Montreal, QC H2V 2J2, Canada.,Centre for Research in Language, Brain, and Music, Montreal, QC H3A 1E3, Canada.,Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program
| |
Collapse
|
23
|
Endo N, Ito T, Mochida T, Ijiri T, Watanabe K, Nakazawa K. Precise force controls enhance loudness discrimination of self-generated sound. Exp Brain Res 2021; 239:1141-1149. [PMID: 33555383 DOI: 10.1007/s00221-020-05993-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2020] [Accepted: 11/19/2020] [Indexed: 10/22/2022]
Abstract
Motor executions alter sensory processes. Studies have shown that loudness perception changes when a sound is generated by active movement. However, it is still unknown where and how the motor-related changes in loudness perception depend on the task demand of motor execution. We examined whether different levels of precision demands in motor control affects loudness perception. We carried out a loudness discrimination test, in which the sound stimulus was produced in conjunction with the force generation task. We tested three target force amplitude levels. The force target was presented on a monitor as a fixed visual target. The generated force was also presented on the same monitor as a movement of the visual cursor. Participants adjusted their force amplitude in a predetermined range without overshooting using these visual targets and moving cursor. In the control condition, the sound and visual stimuli were generated externally (without a force generation task). We found that the discrimination performance was significantly improved when the sound was produced by the force generation task compared to the control condition, in which the sound was produced externally, although we did not find that this improvement in discrimination performance changed depending on the different target force amplitude levels. The results suggest that the demand for precise control to produce a fixed amount of force may be key to obtaining the facilitatory effect of motor execution in auditory processes.
Collapse
Affiliation(s)
- Nozomi Endo
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1, Komaba, Meguro-ku, Tokyo, 153-8902, Japan.,Faculty of Science and Engineering, Waseda University, 3-4-1, Ohkubo, Shinjuku-ku, Tokyo, 169-8555, Japan.,Japan Society for the Promotion of Science, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo, 102-0083, Japan
| | - Takayuki Ito
- Univ. Grenoble Alps, Grenoble-INP, CNRS, GIPSA-Lab, 11 rue des Mathématiques, Grenoble Campus BP46, 38402, Saint Martin D'heres Cedex, France.,Haskins Laboratories, 300 George Street, New Haven, CT, 06511, USA
| | - Takemi Mochida
- NTT Communication Science Laboratories, 3-1, Morinosato Wakamiya, Atsugi-shi, Kanagawa, 243-0198, Japan
| | - Tetsuya Ijiri
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1, Komaba, Meguro-ku, Tokyo, 153-8902, Japan
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, 3-4-1, Ohkubo, Shinjuku-ku, Tokyo, 169-8555, Japan.,Art & Design, University of New South Wales, Oxford St & Greens Rd, Paddington, NSW 202, Australia
| | - Kimitaka Nakazawa
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1, Komaba, Meguro-ku, Tokyo, 153-8902, Japan.
| |
Collapse
|
24
|
Assaneo MF, Rimmele JM, Sanz Perl Y, Poeppel D. Speaking rhythmically can shape hearing. Nat Hum Behav 2021; 5:71-82. [PMID: 33046860 DOI: 10.1038/s41562-020-00962-0] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Accepted: 09/09/2020] [Indexed: 01/28/2023]
Abstract
Evidence suggests that temporal predictions arising from the motor system can enhance auditory perception. However, in speech perception, we lack evidence of perception being modulated by production. Here we show a behavioural protocol that captures the existence of such auditory-motor interactions. Participants performed a syllable discrimination task immediately after producing periodic syllable sequences. Two speech rates were explored: a 'natural' (individually preferred) and a fixed 'non-natural' (2 Hz) rate. Using a decoding approach, we show that perceptual performance is modulated by the stimulus phase determined by a participant's own motor rhythm. Remarkably, for 'natural' and 'non-natural' rates, this finding is restricted to a subgroup of the population with quantifiable auditory-motor coupling. The observed pattern is compatible with a neural model assuming a bidirectional interaction of auditory and speech motor cortices. Crucially, the model matches the experimental results only if it incorporates individual differences in the strength of the auditory-motor connection.
Collapse
Affiliation(s)
- M Florencia Assaneo
- Department of Psychology, New York University, New York, NY, USA. .,Instituto de Neurobiología, Universidad Nacional Autónoma de México, Santiago de Querétaro, Mexico.
| | - Johanna M Rimmele
- Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany.
| | - Yonatan Sanz Perl
- Department of Physics, FCEyN, University of Buenos Aires, Buenos Aires, Argentina.,National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina.,University of San Andrés, Buenos Aires, Argentina
| | - David Poeppel
- Department of Psychology, New York University, New York, NY, USA.,Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| |
Collapse
|
25
|
Cannon JJ, Patel AD. How Beat Perception Co-opts Motor Neurophysiology. Trends Cogn Sci 2020; 25:137-150. [PMID: 33353800 DOI: 10.1016/j.tics.2020.11.002] [Citation(s) in RCA: 70] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Revised: 11/06/2020] [Accepted: 11/12/2020] [Indexed: 02/08/2023]
Abstract
Beat perception offers cognitive scientists an exciting opportunity to explore how cognition and action are intertwined in the brain even in the absence of movement. Many believe the motor system predicts the timing of beats, yet current models of beat perception do not specify how this is neurally implemented. Drawing on recent insights into the neurocomputational properties of the motor system, we propose that beat anticipation relies on action-like processes consisting of precisely patterned neural time-keeping activity in the supplementary motor area (SMA), orchestrated and sequenced by activity in the dorsal striatum. In addition to synthesizing recent advances in cognitive science and motor neuroscience, our framework provides testable predictions to guide future work.
Collapse
Affiliation(s)
- Jonathan J Cannon
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Aniruddh D Patel
- Department of Psychology, Tufts University, Medford, MA, USA; Program in Brain, Mind, and Consciousness, Canadian Institute for Advanced Research (CIFAR), Toronto, CA.
| |
Collapse
|
26
|
Schultz BG, Brown RM, Kotz SA. Dynamic acoustic salience evokes motor responses. Cortex 2020; 134:320-332. [PMID: 33340879 DOI: 10.1016/j.cortex.2020.10.019] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Revised: 06/25/2020] [Accepted: 10/08/2020] [Indexed: 11/28/2022]
Abstract
Audio-motor integration is currently viewed as a predictive process in which the brain simulates upcoming sounds based on voluntary actions. This perspective does not consider how our auditory environment may trigger involuntary action in the absence of prediction. We address this issue by examining the relationship between acoustic salience and involuntary motor responses. We investigate how acoustic features in music contribute to the perception of salience, and whether those features trigger involuntary peripheral motor responses. Participants with little-to-no musical training listened to musical excerpts once while remaining still during the recording of their muscle activity with surface electromyography (sEMG), and again while they continuously rated perceived salience within the music using a slider. We show cross-correlations between 1) salience ratings and acoustic features, 2) acoustic features and spontaneous muscle activity, and 3) salience ratings and spontaneous muscle activity. Amplitude, intensity, and spectral centroid were perceived as the most salient features in music, and fluctuations in these features evoked involuntary peripheral muscle responses. Our results suggest an involuntary mechanism for audio-motor integration, which may rely on brainstem-spinal or brainstem-cerebellar-spinal pathways. Based on these results, we argue that a new framework is needed to explain the full range of human sensorimotor capabilities. This goal can be achieved by considering how predictive and reactive audio-motor integration mechanisms could operate independently or interactively to optimize human behavior.
Collapse
Affiliation(s)
- Benjamin G Schultz
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands
| | - Rachel M Brown
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands
| | - Sonja A Kotz
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands.
| |
Collapse
|
27
|
Betti V, Della Penna S, de Pasquale F, Corbetta M. Spontaneous Beta Band Rhythms in the Predictive Coding of Natural Stimuli. Neuroscientist 2020; 27:184-201. [PMID: 32538310 PMCID: PMC7961741 DOI: 10.1177/1073858420928988] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
The regularity of the physical world and the biomechanics of the human body movements generate distributions of highly probable states that are internalized by the brain in the course of a lifetime. In Bayesian terms, the brain exploits prior knowledge, especially under conditions when sensory input is unavailable or uncertain, to predictively anticipate the most likely outcome of upcoming stimuli and movements. These internal models, formed during development, yet still malleable in adults, continuously adapt through the learning of novel stimuli and movements. Traditionally, neural beta (β) oscillations are considered essential for maintaining sensorimotor and cognitive representations, and for temporal coding of expectations. However, recent findings show that fluctuations of β band power in the resting state strongly correlate between cortical association regions. Moreover, central (hub) regions form strong interactions over time with different brain regions/networks (dynamic core). β band centrality fluctuations of regions of the dynamic core predict global efficiency peaks suggesting a mechanism for network integration. Furthermore, this temporal architecture is surprisingly stable, both in topology and dynamics, during the observation of ecological natural visual scenes, whereas synthetic temporally scrambled stimuli modify it. We propose that spontaneous β rhythms may function as a long-term “prior” of frequent environmental stimuli and behaviors.
Collapse
Affiliation(s)
- Viviana Betti
- Department of Psychology, Sapienza University of Rome, Rome, Italy.,IRCCS Fondazione Santa Lucia, Rome, Italy
| | - Stefania Della Penna
- Institute for Advanced Biomedical Technologies and Department of Neuroscience, Imaging and Clinical Sciences, "G. D'Annunzio" University, Chieti, Italy
| | | | - Maurizio Corbetta
- Department of Neuroscience and Padova Neuroscience Center (PNC), University of Padua, Padua, Italy.,Venetian Institute of Molecular Medicine (VIMM), Padua, Italy.,Department of Neurology, Radiology, and Neuroscience, Washington University in St. Louis, St. Louis, MO, USA
| |
Collapse
|
28
|
Baroni F, Morillon B, Trébuchon A, Liégeois-Chauvel C, Olasagasti I, Giraud AL. Converging intracortical signatures of two separated processing timescales in human early auditory cortex. Neuroimage 2020; 218:116882. [PMID: 32439539 DOI: 10.1016/j.neuroimage.2020.116882] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 03/30/2020] [Accepted: 04/23/2020] [Indexed: 11/15/2022] Open
Abstract
Neural oscillations in auditory cortex are argued to support parsing and representing speech constituents at their corresponding temporal scales. Yet, how incoming sensory information interacts with ongoing spontaneous brain activity, what features of the neuronal microcircuitry underlie spontaneous and stimulus-evoked spectral fingerprints, and what these fingerprints entail for stimulus encoding, remain largely open questions. We used a combination of human invasive electrophysiology, computational modeling and decoding techniques to assess the information encoding properties of brain activity and to relate them to a plausible underlying neuronal microarchitecture. We analyzed intracortical auditory EEG activity from 10 patients while they were listening to short sentences. Pre-stimulus neural activity in early auditory cortical regions often exhibited power spectra with a shoulder in the delta range and a small bump in the beta range. Speech decreased power in the beta range, and increased power in the delta-theta and gamma ranges. Using multivariate machine learning techniques, we assessed the spectral profile of information content for two aspects of speech processing: detection and discrimination. We obtained better phase than power information decoding, and a bimodal spectral profile of information content with better decoding at low (delta-theta) and high (gamma) frequencies than at intermediate (beta) frequencies. These experimental data were reproduced by a simple rate model made of two subnetworks with different timescales, each composed of coupled excitatory and inhibitory units, and connected via a negative feedback loop. Modeling and experimental results were similar in terms of pre-stimulus spectral profile (except for the iEEG beta bump), spectral modulations with speech, and spectral profile of information content. Altogether, we provide converging evidence from both univariate spectral analysis and decoding approaches for a dual timescale processing infrastructure in human auditory cortex, and show that it is consistent with the dynamics of a simple rate model.
Collapse
Affiliation(s)
- Fabiano Baroni
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland; School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
| | - Benjamin Morillon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France
| | - Agnès Trébuchon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Clinical Neurophysiology and Epileptology Department, Timone Hospital, Assistance Publique Hôpitaux de Marseille, Marseille, France
| | - Catherine Liégeois-Chauvel
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Department of Neurological Surgery, University of Pittsburgh, PA, 15213, USA
| | - Itsaso Olasagasti
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| | - Anne-Lise Giraud
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| |
Collapse
|
29
|
Rajendran VG, Harper NS, Schnupp JWH. Auditory cortical representation of music favours the perceived beat. ROYAL SOCIETY OPEN SCIENCE 2020; 7:191194. [PMID: 32269783 PMCID: PMC7137933 DOI: 10.1098/rsos.191194] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Accepted: 02/03/2020] [Indexed: 06/02/2023]
Abstract
Previous research has shown that musical beat perception is a surprisingly complex phenomenon involving widespread neural coordination across higher-order sensory, motor and cognitive areas. However, the question of how low-level auditory processing must necessarily shape these dynamics, and therefore perception, is not well understood. Here, we present evidence that the auditory cortical representation of music, even in the absence of motor or top-down activations, already favours the beat that will be perceived. Extracellular firing rates in the rat auditory cortex were recorded in response to 20 musical excerpts diverse in tempo and genre, for which musical beat perception had been characterized by the tapping behaviour of 40 human listeners. We found that firing rates in the rat auditory cortex were on average higher on the beat than off the beat. This 'neural emphasis' distinguished the beat that was perceived from other possible interpretations of the beat, was predictive of the degree of tapping consensus across human listeners, and was accounted for by a spectrotemporal receptive field model. These findings strongly suggest that the 'bottom-up' processing of music performed by the auditory system predisposes the timing and clarity of the perceived musical beat.
Collapse
Affiliation(s)
- Vani G. Rajendran
- Auditory Neuroscience Group, Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford, UK
- Department of Biomedical Sciences, City University of Hong Kong, Kowloon Tong, Hong Kong
| | - Nicol S. Harper
- Auditory Neuroscience Group, Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford, UK
| | - Jan W. H. Schnupp
- Auditory Neuroscience Group, Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford, UK
- Department of Biomedical Sciences, City University of Hong Kong, Kowloon Tong, Hong Kong
| |
Collapse
|
30
|
Benedetto A, Morrone MC. Visual sensitivity and bias oscillate phase-locked to saccadic eye movements. J Vis 2019; 19:15. [DOI: 10.1167/19.14.15] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Alessandro Benedetto
- Dipartimento di Ricerca Traslazionale e delle Nuove Tecnologie in Medicina e Chirurgia, Università di Pisa, Pisa, Italy
| | - Maria Concetta Morrone
- Dipartimento di Ricerca Traslazionale e delle Nuove Tecnologie in Medicina e Chirurgia, Università di Pisa, Pisa, Italy
| |
Collapse
|
31
|
Morillon B, Arnal LH, Schroeder CE, Keitel A. Prominence of delta oscillatory rhythms in the motor cortex and their relevance for auditory and speech perception. Neurosci Biobehav Rev 2019; 107:136-142. [DOI: 10.1016/j.neubiorev.2019.09.012] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Revised: 07/25/2019] [Accepted: 09/09/2019] [Indexed: 01/21/2023]
|
32
|
Distinct Mechanisms of Imagery Differentially Influence Speech Perception. eNeuro 2019; 6:ENEURO.0261-19.2019. [PMID: 31481396 PMCID: PMC6753248 DOI: 10.1523/eneuro.0261-19.2019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 08/21/2019] [Accepted: 08/23/2019] [Indexed: 12/03/2022] Open
Abstract
Neural representation can be induced without external stimulation, such as in mental imagery. Our previous study found that imagined speaking and imagined hearing modulated perceptual neural responses in opposite directions, suggesting motor-to-sensory transformation and memory retrieval as two separate routes that induce auditory representation (Tian and Poeppel, 2013). We hypothesized that the precision of representation induced from different types of speech imagery led to different modulation effects. Specifically, we predicted that the one-to-one mapping between motor and sensory domains established during speech production would evoke a more precise auditory representation in imagined speaking than retrieving the same sounds from memory in imagined hearing. To test this hypothesis, we built the function of representational precision as the modulation of connection strength in a neural network model. The model fitted the magnetoencephalography (MEG) imagery repetition effects, and the best-fitting parameters showed sharper tuning after imagined speaking than imagined hearing, consistent with the representational precision hypothesis. Moreover, this model predicted that different types of speech imagery would affect perception differently. In an imagery-adaptation experiment, the categorization of /ba/-/da/ continuum from male and female human participants showed more positive shifts towards the preceding imagined syllable after imagined speaking than imagined hearing. These consistent simulation and behavioral results support our hypothesis that distinct mechanisms of speech imagery construct auditory representation with varying degrees of precision and differentially influence auditory perception. This study provides a mechanistic connection between neural-level activity and psychophysics that reveals the neural computation of mental imagery.
Collapse
|
33
|
Abstract
Recent evidence suggests that the motor system may have a facilitatory role in speech perception during noisy listening conditions. Studies clearly show an association between activity in auditory and motor speech systems, but also hint at a causal role for the motor system in noisy speech perception. However, in the most compelling "causal" studies performance was only measured at a single signal-to-noise ratio (SNR). If listening conditions must be noisy to invoke causal motor involvement, then effects will be contingent on the SNR at which they are tested. We used articulatory suppression to disrupt motor-speech areas while measuring phonemic identification across a range of SNRs. As controls, we also measured phoneme identification during passive listening, mandible gesturing, and foot-tapping conditions. Two-parameter (threshold, slope) psychometric functions were fit to the data in each condition. Our findings indicate: (1) no effect of experimental task on psychometric function slopes; (2) a small effect of articulatory suppression, in particular, on psychometric function thresholds. The size of the latter effect was 1 dB (~5% correct) on average, suggesting, at best, a minor modulatory role of the speech motor system in perception.
Collapse
Affiliation(s)
- Ryan C Stokes
- Department of Cognitive Sciences Social and Behavioral Sciences Gateway, University of California - Irvine, Irvine, CA, 92697-5100, USA.
| | - Jonathan H Venezia
- Department of Cognitive Sciences Social and Behavioral Sciences Gateway, University of California - Irvine, Irvine, CA, 92697-5100, USA
| | - Gregory Hickok
- Department of Cognitive Sciences Social and Behavioral Sciences Gateway, University of California - Irvine, Irvine, CA, 92697-5100, USA
| |
Collapse
|
34
|
Leszczynski M, Schroeder CE. The Role of Neuronal Oscillations in Visual Active Sensing. Front Integr Neurosci 2019; 13:32. [PMID: 31396059 PMCID: PMC6664014 DOI: 10.3389/fnint.2019.00032] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2019] [Accepted: 07/03/2019] [Indexed: 01/22/2023] Open
Abstract
Visual perception is most often studied as a "passive" process in which an observer fixates steadily at point in space so that stimuli can be delivered to the system with spatial precision. Analysis of neuronal signals related to vision is generally keyed to stimulus onset, stimulus movement, etc.; i.e., events external to the observer. In natural "active" vision, however, information is systematically acquired by using eye movements including rapid (saccadic) eye movements, as well as smooth ocular pursuit of moving objects and slower drifts. Here we consider the use of alternating saccades and fixations to gather information from a visual scene. The underlying motor sampling plan contains highly reliable information regarding "where" and "when" the eyes will land, this information can be used predictively to modify firing properties of neurons precisely at the time when this "contextual" information is most useful - when a volley of retinal input enters the system at the onset of each fixation. Analyses focusing on neural events leading to and resulting from shifts in fixation, as well as visual events external to the observer, can provide a more complete and mechanistic understanding of visual information processing. Studies thus far suggest that active vision may be a fundamentally different from that process we usually study with more traditional passive viewing paradigms. In this Perspective we note that active saccadic sampling behavior imposes robust temporal patterning on the activity of neuron ensembles and large-scale neural dynamics throughout the brain's visual pathways whose mechanistic effects on information processing are not yet fully understood. The spatio-temporal sequence of eye movements elicits a succession of temporally predictable quasi-rhythmic sensory inputs, whose encoding is enhanced by entrainment of low frequency oscillations to the rate of eye movements. Review of the pertinent findings underscores the fact that temporal coordination between motor and visual cortices is critical for understanding neural dynamics of active vision and posits that phase entrainment of neuronal oscillations plays a mechanistic role in this process.
Collapse
Affiliation(s)
- Marcin Leszczynski
- Department of Neurological Surgery, College of Physicians and Surgeons, Columbia University, New York, NY, United States
- Translational Neuroscience Laboratories, The Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States
| | - Charles E. Schroeder
- Department of Neurological Surgery, College of Physicians and Surgeons, Columbia University, New York, NY, United States
- Translational Neuroscience Laboratories, The Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States
| |
Collapse
|
35
|
Kral A, Dorman MF, Wilson BS. Neuronal Development of Hearing and Language: Cochlear Implants and Critical Periods. Annu Rev Neurosci 2019; 42:47-65. [DOI: 10.1146/annurev-neuro-080317-061513] [Citation(s) in RCA: 71] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The modern cochlear implant (CI) is the most successful neural prosthesis developed to date. CIs provide hearing to the profoundly hearing impaired and allow the acquisition of spoken language in children born deaf. Results from studies enabled by the CI have provided new insights into ( a) minimal representations at the periphery for speech reception, ( b) brain mechanisms for decoding speech presented in quiet and in acoustically adverse conditions, ( c) the developmental neuroscience of language and hearing, and ( d) the mechanisms and time courses of intramodal and cross-modal plasticity. Additionally, the results have underscored the interconnectedness of brain functions and the importance of top-down processes in perception and learning. The findings are described in this review with emphasis on the developing brain and the acquisition of hearing and spoken language.
Collapse
Affiliation(s)
- Andrej Kral
- Institute of AudioNeuroTechnology and Department of Experimental Otology, ENT Clinics, Hannover Medical University, 30625 Hannover, Germany
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, Texas 75080, USA
- School of Medicine and Health Sciences, Macquarie University, Sydney, New South Wales 2109, Australia
| | - Michael F. Dorman
- Department of Speech and Hearing Science, Arizona State University, Tempe, Arizona 85287, USA
| | - Blake S. Wilson
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, Texas 75080, USA
- School of Medicine and Pratt School of Engineering, Duke University, Durham, North Carolina 27708, USA
| |
Collapse
|
36
|
Benedetto A, Morrone MC, Tomassini A. The Common Rhythm of Action and Perception. J Cogn Neurosci 2019; 32:187-200. [PMID: 31210564 DOI: 10.1162/jocn_a_01436] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Research in the last decade has undermined the idea of perception as a continuous process, providing strong empirical support for its rhythmic modulation. More recently, it has been revealed that the ongoing motor processes influence the rhythmic sampling of sensory information. In this review, we will focus on a growing body of evidence suggesting that oscillation-based mechanisms may structure the dynamic interplay between the motor and sensory system and provide a unified temporal frame for their effective coordination. We will describe neurophysiological data, primarily collected in animals, showing phase-locking of neuronal oscillations to the onset of (eye) movements. These data are complemented by novel evidence in humans, which demonstrate the behavioral relevance of these oscillatory modulations and their domain-general nature. Finally, we will discuss the possible implications of these modulations for action-perception coupling mechanisms.
Collapse
|
37
|
Concha-Miranda M, Ríos J, Bou J, Valdes JL, Maldonado PE. Timing Is of the Essence: Improvement in Perception During Active Sensing. Front Behav Neurosci 2019; 13:96. [PMID: 31143104 PMCID: PMC6520616 DOI: 10.3389/fnbeh.2019.00096] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2018] [Accepted: 04/18/2019] [Indexed: 12/25/2022] Open
Abstract
Active sensing refers to the concept of animals perceiving their environment while involving self-initiated motor acts. As a consequence of these motor acts, this activity produces direct and timely changes in the sensory surface. Is the brain able to take advantage of the precise time-locking that occurs during active sensing? Is the intrinsic predictability present during active sensing, impacting the sensory processes? We conjecture that if stimuli presentation is evoked by a self-initiated motor act, sensory discrimination and timing accuracy would improve. We studied this phenomenon when rats had to locate the position of a brief light stimulus, either when it was elicited by a warning light [passive condition (PC)] or when it was generated by a lever press [active condition (AC)]. We found that during the PC, rats had 66% of correct responses, vs. a significantly higher 77% of correct responses in AC. Furthermore, reaction times reduced from 1,181 ms during AC to 816 ms during PC For the latter condition, the probability of detecting the side of the light stimulus was negatively correlated with the time lag between the motor act and the evoked light and with a 38% reduction on performance per second of delay. These experiment shows that the mechanism that underlies sensory improvement during active behaviors have a constrained time dynamic, where the peak performances occur during the motor act, decreasing proportionally to the lag between the motor act and the stimulus presentation. This result is consistent with the evidence already found in humans, of a precise time dynamic of the improvement of sensory acuity after a motor act and reveals an equivalent process in rodents. Our results support the idea that perception and action are precisely coordinated in the brain.
Collapse
Affiliation(s)
- Miguel Concha-Miranda
- Laboratory of Neurosystems, Neuroscience Department, Faculty of Medicine, Universidad de Chile, Santiago, Chile
| | - Javier Ríos
- Laboratory of Neurosystems, Neuroscience Department, Faculty of Medicine, Universidad de Chile, Santiago, Chile
| | - Joaquín Bou
- Laboratory of Neurosystems, Neuroscience Department, Faculty of Medicine, Universidad de Chile, Santiago, Chile
| | - Jose Luis Valdes
- Laboratory of Neurosystems, Neuroscience Department, Faculty of Medicine, Universidad de Chile, Santiago, Chile.,Faculty of Medicine, Biomedical Neuroscience Institute (BNI), Santiago, Chile
| | - Pedro E Maldonado
- Laboratory of Neurosystems, Neuroscience Department, Faculty of Medicine, Universidad de Chile, Santiago, Chile.,Faculty of Medicine, Biomedical Neuroscience Institute (BNI), Santiago, Chile
| |
Collapse
|
38
|
Making the Environment an Informative Place: A Conceptual Analysis of Epistemic Policies and Sensorimotor Coordination. ENTROPY 2019; 21:e21040350. [PMID: 33267064 PMCID: PMC7514834 DOI: 10.3390/e21040350] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 03/20/2019] [Accepted: 03/25/2019] [Indexed: 01/02/2023]
Abstract
How do living organisms decide and act with limited and uncertain information? Here, we discuss two computational approaches to solving these challenging problems: a "cognitive" and a "sensorimotor" enrichment of stimuli, respectively. In both approaches, the key notion is that agents can strategically modulate their behavior in informative ways, e.g., to disambiguate amongst alternative hypotheses or to favor the perception of stimuli providing the information necessary to later act appropriately. We discuss how, despite their differences, both approaches appeal to the notion that actions must obey both epistemic (i.e., information-gathering or uncertainty-reducing) and pragmatic (i.e., goal- or reward-maximizing) imperatives and balance them. Our computationally-guided analysis reveals that epistemic behavior is fundamental to understanding several facets of cognitive processing, including perception, decision making, and social interaction.
Collapse
|
39
|
Motor output, neural states and auditory perception. Neurosci Biobehav Rev 2019; 96:116-126. [DOI: 10.1016/j.neubiorev.2018.10.021] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2018] [Revised: 10/26/2018] [Accepted: 10/29/2018] [Indexed: 12/12/2022]
|
40
|
Fink LK, Hurley BK, Geng JJ, Janata P. A linear oscillator model predicts dynamic temporal attention and pupillary entrainment to rhythmic patterns. J Eye Mov Res 2018; 11. [PMID: 33828695 PMCID: PMC7898576 DOI: 10.16910/jemr.11.2.12] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Rhythm is a ubiquitous feature of music that induces specific neural modes of processing. In this
paper, we assess the potential of a stimulus-driven linear oscillator model (57)
to predict dynamic attention to complex musical rhythms on an instant-by-instant basis. We use
perceptual thresholds and pupillometry as attentional indices against which to test our model predictions.
During a deviance detection task, participants listened to continuously looping, multiinstrument,
rhythmic patterns, while being eye-tracked. Their task was to respond anytime they
heard an increase in intensity (dB SPL). An adaptive thresholding algorithm adjusted deviant intensity
at multiple probed temporal locations throughout each rhythmic stimulus. The oscillator
model predicted participants’ perceptual thresholds for detecting deviants at probed locations, with
a low temporal salience prediction corresponding to a high perceptual threshold and vice versa. A
pupil dilation response was observed for all deviants. Notably, the pupil dilated even when participants
did not report hearing a deviant. Maximum pupil size and resonator model output were significant
predictors of whether a deviant was detected or missed on any given trial. Besides the
evoked pupillary response to deviants, we also assessed the continuous pupillary signal to the
rhythmic patterns. The pupil exhibited entrainment at prominent periodicities present in the stimuli
and followed each of the different rhythmic patterns in a unique way. Overall, these results replicate
previous studies using the linear oscillator model to predict dynamic attention to complex
auditory scenes and extend the utility of the model to the prediction of neurophysiological signals,
in this case the pupillary time course; however, we note that the amplitude envelope of the acoustic
patterns may serve as a similarly useful predictor. To our knowledge, this is the first paper to show
entrainment of pupil dynamics by demonstrating a phase relationship between musical stimuli and
the pupillary signal.
Collapse
|
41
|
Biau E, Kotz SA. Lower Beta: A Central Coordinator of Temporal Prediction in Multimodal Speech. Front Hum Neurosci 2018; 12:434. [PMID: 30405383 PMCID: PMC6207805 DOI: 10.3389/fnhum.2018.00434] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 10/03/2018] [Indexed: 12/18/2022] Open
Abstract
How the brain decomposes and integrates information in multimodal speech perception is linked to oscillatory dynamics. However, how speech takes advantage of redundancy between different sensory modalities, and how this translates into specific oscillatory patterns remains unclear. We address the role of lower beta activity (~20 Hz), generally associated with motor functions, as an amodal central coordinator that receives bottom-up delta-theta copies from specific sensory areas and generate top-down temporal predictions for auditory entrainment. Dissociating temporal prediction from entrainment may explain how and why visual input benefits speech processing rather than adding cognitive load in multimodal speech perception. On the one hand, body movements convey prosodic and syllabic features at delta and theta rates (i.e., 1–3 Hz and 4–7 Hz). On the other hand, the natural precedence of visual input before auditory onsets may prepare the brain to anticipate and facilitate the integration of auditory delta-theta copies of the prosodic-syllabic structure. Here, we identify three fundamental criteria based on recent evidence and hypotheses, which support the notion that lower motor beta frequency may play a central and generic role in temporal prediction during speech perception. First, beta activity must respond to rhythmic stimulation across modalities. Second, beta power must respond to biological motion and speech-related movements conveying temporal information in multimodal speech processing. Third, temporal prediction may recruit a communication loop between motor and primary auditory cortices (PACs) via delta-to-beta cross-frequency coupling. We discuss evidence related to each criterion and extend these concepts to a beta-motivated framework of multimodal speech processing.
Collapse
Affiliation(s)
- Emmanuel Biau
- Basic and Applied Neuro Dynamics Laboratory, Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, University of Maastricht, Maastricht, Netherlands
| | - Sonja A Kotz
- Basic and Applied Neuro Dynamics Laboratory, Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, University of Maastricht, Maastricht, Netherlands.,Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
42
|
Proactive Sensing of Periodic and Aperiodic Auditory Patterns. Trends Cogn Sci 2018; 22:870-882. [DOI: 10.1016/j.tics.2018.08.003] [Citation(s) in RCA: 134] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Revised: 08/12/2018] [Accepted: 08/13/2018] [Indexed: 11/18/2022]
|
43
|
Temporal expectancies and rhythmic cueing in touch: The influence of spatial attention. Cognition 2018; 182:140-150. [PMID: 30248473 DOI: 10.1016/j.cognition.2018.09.011] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Revised: 09/12/2018] [Accepted: 09/15/2018] [Indexed: 11/20/2022]
Abstract
Attention resources can be allocated in both space and time. Exogenous temporal attention can be driven by rhythmic events in our environment which automatically entrain periods of attention. Temporal expectancies can also be generated by the elapse of time, leading to foreperiod effects (the longer between a cue and imperative target, the faster the response). This study investigates temporal attention in touch and the influence of spatial orienting. In experiment 1, participants used bilateral tactile cues to orient endogenous spatial attention to the left or right hand where a unilateral tactile target was presented. This facilitated response times for attended over unattended targets. In experiment 2, the cue was unilateral and non-predictive of the target location resulting in inhibition of return. Importantly, the cue was rhythmic and targets were presented early, in synchrony or late in relation to the rhythmic cue. A foreperiod effect was observed in experiment 1 that was independent from any spatial attention effects. In experiment 2, in synchrony were slower compared to out of synchrony targets but only for cued and not uncued targets, suggesting the rhythm generates periods of exogenous inhibition. Taken together, temporal and spatial attention interact in touch, but only when both types of attention are exogenous. If the task requires endogenous spatial orienting, space and time are independent.
Collapse
|
44
|
Holt LL, Tierney AT, Guerra G, Laffere A, Dick F. Dimension-selective attention as a possible driver of dynamic, context-dependent re-weighting in speech processing. Hear Res 2018; 366:50-64. [PMID: 30131109 PMCID: PMC6107307 DOI: 10.1016/j.heares.2018.06.014] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2018] [Revised: 06/10/2018] [Accepted: 06/19/2018] [Indexed: 12/24/2022]
Abstract
The contribution of acoustic dimensions to an auditory percept is dynamically adjusted and reweighted based on prior experience about how informative these dimensions are across the long-term and short-term environment. This is especially evident in speech perception, where listeners differentially weight information across multiple acoustic dimensions, and use this information selectively to update expectations about future sounds. The dynamic and selective adjustment of how acoustic input dimensions contribute to perception has made it tempting to conceive of this as a form of non-spatial auditory selective attention. Here, we review several human speech perception phenomena that might be consistent with auditory selective attention although, as of yet, the literature does not definitively support a mechanistic tie. We relate these human perceptual phenomena to illustrative nonhuman animal neurobiological findings that offer informative guideposts in how to test mechanistic connections. We next present a novel empirical approach that can serve as a methodological bridge from human research to animal neurobiological studies. Finally, we describe four preliminary results that demonstrate its utility in advancing understanding of human non-spatial dimension-based auditory selective attention.
Collapse
Affiliation(s)
- Lori L Holt
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA; Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA.
| | - Adam T Tierney
- Department of Psychological Sciences, Birkbeck College, University of London, London, WC1E 7HX, UK; Centre for Brain and Cognitive Development, Birkbeck College, London, WC1E 7HX, UK
| | - Giada Guerra
- Department of Psychological Sciences, Birkbeck College, University of London, London, WC1E 7HX, UK; Centre for Brain and Cognitive Development, Birkbeck College, London, WC1E 7HX, UK
| | - Aeron Laffere
- Department of Psychological Sciences, Birkbeck College, University of London, London, WC1E 7HX, UK
| | - Frederic Dick
- Department of Psychological Sciences, Birkbeck College, University of London, London, WC1E 7HX, UK; Centre for Brain and Cognitive Development, Birkbeck College, London, WC1E 7HX, UK; Department of Experimental Psychology, University College London, London, WC1H 0AP, UK
| |
Collapse
|
45
|
Not All Predictions Are Equal: "What" and "When" Predictions Modulate Activity in Auditory Cortex through Different Mechanisms. J Neurosci 2018; 38:8680-8693. [PMID: 30143578 DOI: 10.1523/jneurosci.0369-18.2018] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2018] [Revised: 07/22/2018] [Accepted: 07/26/2018] [Indexed: 11/21/2022] Open
Abstract
Using predictions based on environmental regularities is fundamental for adaptive behavior. While it is widely accepted that predictions across different stimulus attributes (e.g., time and content) facilitate sensory processing, it is unknown whether predictions across these attributes rely on the same neural mechanism. Here, to elucidate the neural mechanisms of predictions, we combine invasive electrophysiological recordings (human electrocorticography in 4 females and 2 males) with computational modeling while manipulating predictions about content ("what") and time ("when"). We found that "when" predictions increased evoked activity over motor and prefrontal regions both at early (∼180 ms) and late (430-450 ms) latencies. "What" predictability, however, increased evoked activity only over prefrontal areas late in time (420-460 ms). Beyond these dissociable influences, we found that "what" and "when" predictability interactively modulated the amplitude of early (165 ms) evoked responses in the superior temporal gyrus. We modeled the observed neural responses using biophysically realistic neural mass models, to better understand whether "what" and "when" predictions tap into similar or different neurophysiological mechanisms. Our modeling results suggest that "what" and "when" predictability rely on complementary neural processes: "what" predictions increased short-term plasticity in auditory areas, whereas "when" predictability increased synaptic gain in motor areas. Thus, content and temporal predictions engage complementary neural mechanisms in different regions, suggesting domain-specific prediction signaling along the cortical hierarchy. Encoding predictions through different mechanisms may endow the brain with the flexibility to efficiently signal different sources of predictions, weight them by their reliability, and allow for their encoding without mutual interference.SIGNIFICANCE STATEMENT Predictions of different stimulus features facilitate sensory processing. However, it is unclear whether predictions of different attributes rely on similar or different neural mechanisms. By combining invasive electrophysiological recordings of cortical activity with experimental manipulations of participants' predictions about content and time of acoustic events, we found that the two types of predictions had dissociable influences on cortical activity, both in terms of the regions involved and the timing of the observed effects. Further, our biophysical modeling analysis suggests that predictability of content and time rely on complementary neural processes: short-term plasticity in auditory areas and synaptic gain in motor areas, respectively. This suggests that predictions of different features are encoded with complementary neural mechanisms in different brain regions.
Collapse
|
46
|
Intracortical Microstimulation Modulates Cortical Induced Responses. J Neurosci 2018; 38:7774-7786. [PMID: 30054394 DOI: 10.1523/jneurosci.0928-18.2018] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2018] [Revised: 06/19/2018] [Accepted: 07/06/2018] [Indexed: 12/31/2022] Open
Abstract
Recent advances in cortical prosthetics relied on intracortical microstimulation (ICMS) to activate the cortical neural network and convey information to the brain. Here we show that activity elicited by low-current ICMS modulates induced cortical responses to a sensory stimulus in the primary auditory cortex (A1). A1 processes sensory stimuli in a stereotyped manner, encompassing two types of activity: evoked activity (phase-locked to the stimulus) and induced activity (non-phase-locked to the stimulus). Time-frequency analyses of extracellular potentials recorded from all layers and the surface of the auditory cortex of anesthetized guinea pigs of both sexes showed that ICMS during the processing of a transient acoustic stimulus differentially affected the evoked and induced response. Specifically, ICMS enhanced the long-latency-induced component, mimicking physiological gain increasing top-down feedback processes. Furthermore, the phase of the local field potential at the time of stimulation was predictive of the response amplitude for acoustic stimulation, ICMS, as well as combined acoustic and electric stimulation. Together, this was interpreted as a sign that the response to electrical stimulation was integrated into the ongoing cortical processes in contrast to substituting them. Consequently, ICMS modulated the cortical response to a sensory stimulus. We propose such targeted modulation of cortical activity (as opposed to a stimulation that substitutes the ongoing processes) as an alternative approach for cortical prostheses.SIGNIFICANCE STATEMENT Intracortical microstimulation (ICMS) is commonly used to activate a specific subset of cortical neurons, without taking into account the ongoing activity at the time of stimulation. Here, we found that a low-current ICMS pulse modulated the way the auditory cortex processed a peripheral stimulus, by supra-additively combining the response to the ICMS with the cortical processing of the peripheral stimulus. This artificial modulation mimicked natural modulations of response magnitude such as attention or expectation. In contrast to what was implied in earlier studies, this shows that the response to electrical stimulation is not substituting ongoing cortical activity but is integrated into the natural processes.
Collapse
|
47
|
Delis I, Dmochowski JP, Sajda P, Wang Q. Correlation of neural activity with behavioral kinematics reveals distinct sensory encoding and evidence accumulation processes during active tactile sensing. Neuroimage 2018; 175:12-21. [PMID: 29580968 PMCID: PMC5960621 DOI: 10.1016/j.neuroimage.2018.03.035] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Revised: 02/21/2018] [Accepted: 03/17/2018] [Indexed: 12/16/2022] Open
Abstract
Many real-world decisions rely on active sensing, a dynamic process for directing our sensors (e.g. eyes or fingers) across a stimulus to maximize information gain. Though ecologically pervasive, limited work has focused on identifying neural correlates of the active sensing process. In tactile perception, we often make decisions about an object/surface by actively exploring its shape/texture. Here we investigate the neural correlates of active tactile decision-making by simultaneously measuring electroencephalography (EEG) and finger kinematics while subjects interrogated a haptic surface to make perceptual judgments. Since sensorimotor behavior underlies decision formation in active sensing tasks, we hypothesized that the neural correlates of decision-related processes would be detectable by relating active sensing to neural activity. Novel brain-behavior correlation analysis revealed that three distinct EEG components, localizing to right-lateralized occipital cortex (LOC), middle frontal gyrus (MFG), and supplementary motor area (SMA), respectively, were coupled with active sensing as their activity significantly correlated with finger kinematics. To probe the functional role of these components, we fit their single-trial-couplings to decision-making performance using a hierarchical-drift-diffusion-model (HDDM), revealing that the LOC modulated the encoding of the tactile stimulus whereas the MFG predicted the rate of information integration towards a choice. Interestingly, the MFG disappeared from components uncovered from control subjects performing active sensing but not required to make perceptual decisions. By uncovering the neural correlates of distinct stimulus encoding and evidence accumulation processes, this study delineated, for the first time, the functional role of cortical areas in active tactile decision-making.
Collapse
Affiliation(s)
- Ioannis Delis
- Department of Biomedical Engineering, Columbia University, New York, NY, 10027, USA
| | - Jacek P Dmochowski
- Department of Biomedical Engineering, City College of New York, New York, NY, 10031, USA
| | - Paul Sajda
- Department of Biomedical Engineering, Columbia University, New York, NY, 10027, USA; Data Science Institute, Columbia University, New York, NY, 10027, USA.
| | - Qi Wang
- Department of Biomedical Engineering, Columbia University, New York, NY, 10027, USA.
| |
Collapse
|
48
|
Schroeder KE, Irwin ZT, Bullard AJ, Thompson DE, Bentley JN, Stacey WC, Patil PG, Chestek CA. Robust tactile sensory responses in finger area of primate motor cortex relevant to prosthetic control. J Neural Eng 2018; 14:046016. [PMID: 28504971 DOI: 10.1088/1741-2552/aa7329] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Challenges in improving the performance of dexterous upper-limb brain-machine interfaces (BMIs) have prompted renewed interest in quantifying the amount and type of sensory information naturally encoded in the primary motor cortex (M1). Previous single unit studies in monkeys showed M1 is responsive to tactile stimulation, as well as passive and active movement of the limbs. However, recent work in this area has focused primarily on proprioception. Here we examined instead how tactile somatosensation of the hand and fingers is represented in M1. APPROACH We recorded multi- and single units and thresholded neural activity from macaque M1 while gently brushing individual finger pads at 2 Hz. We also recorded broadband neural activity from electrocorticogram (ECoG) grids placed on human motor cortex, while applying the same tactile stimulus. MAIN RESULTS Units displaying significant differences in firing rates between individual fingers (p < 0.05) represented up to 76.7% of sorted multiunits across four monkeys. After normalizing by the number of channels with significant motor finger responses, the percentage of electrodes with significant tactile responses was 74.9% ± 24.7%. No somatotopic organization of finger preference was obvious across cortex, but many units exhibited cosine-like tuning across multiple digits. Sufficient sensory information was present in M1 to correctly decode stimulus position from multiunit activity above chance levels in all monkeys, and also from ECoG gamma power in two human subjects. SIGNIFICANCE These results provide some explanation for difficulties experienced by motor decoders in clinical trials of cortically controlled prosthetic hands, as well as the general problem of disentangling motor and sensory signals in primate motor cortex during dextrous tasks. Additionally, examination of unit tuning during tactile and proprioceptive inputs indicates cells are often tuned differently in different contexts, reinforcing the need for continued refinement of BMI training and decoding approaches to closed-loop BMI systems for dexterous grasping.
Collapse
Affiliation(s)
- Karen E Schroeder
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | | | | | | | | | | | | | | |
Collapse
|
49
|
Theta oscillations mediate pre-activation of highly expected word initial phonemes. Sci Rep 2018; 8:9503. [PMID: 29934613 PMCID: PMC6015046 DOI: 10.1038/s41598-018-27898-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2018] [Accepted: 06/13/2018] [Indexed: 11/21/2022] Open
Abstract
Prediction has been proposed to be a fundamental neurocognitive mechanism. However, its role in language comprehension is currently under debate. In this magnetoencephalography study we aimed to find evidence of word-form phonological pre-activation and to characterize the oscillatory mechanisms supporting this. Participants were presented firstly with a picture of an object, and then, after a delay (fixed or variable), they heard the corresponding word. Target words could contain a phoneme substitution, and participants’ task was to detect mispronunciations. Word-initial phonemes were either fricatives or plosives, generating two experimental conditions (expect-fricative and expect-plosive). In the pre-word interval, significant differences (α = 0.05) emerged between conditions both for fixed and variable delays. Source reconstruction of this effect showed a brain-wide network involving several frequency bands, including bilateral superior temporal areas commonly associated with phonological processing, in a theta range. These results show that phonological representations supported by the theta band may be active before word onset, even under temporal uncertainty. However, in the evoked response just prior to the word, differences between conditions were apparent under variable- but not fixed-delays. This suggests that additional top-down mechanisms sensitive to phonological form may be recruited when there is uncertainty in the signal.
Collapse
|
50
|
Corcoran AW, Pezzulo G, Hohwy J. Commentary: Respiration-Entrained Brain Rhythms Are Global but Often Overlooked. Front Syst Neurosci 2018; 12:25. [PMID: 29937718 PMCID: PMC6003246 DOI: 10.3389/fnsys.2018.00025] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Accepted: 05/16/2018] [Indexed: 11/13/2022] Open
Affiliation(s)
- Andrew W. Corcoran
- Cognition and Philosophy Laboratory, School of Philosophical, Historical and International Studies, Monash University, Melbourne, VIC, Australia
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Jakob Hohwy
- Cognition and Philosophy Laboratory, School of Philosophical, Historical and International Studies, Monash University, Melbourne, VIC, Australia
| |
Collapse
|