1
|
Nguyen T, Lagacé-Cusiac R, Everling JC, Henry MJ, Grahn JA. Audiovisual integration of rhythm in musicians and dancers. Atten Percept Psychophys 2024; 86:1400-1416. [PMID: 38557941 DOI: 10.3758/s13414-024-02874-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/23/2024] [Indexed: 04/04/2024]
Abstract
Music training is associated with better beat processing in the auditory modality. However, it is unknown how rhythmic training that emphasizes visual rhythms, such as dance training, might affect beat processing, nor whether training effects in general are modality specific. Here we examined how music and dance training interacted with modality during audiovisual integration and synchronization to auditory and visual isochronous sequences. In two experiments, musicians, dancers, and controls completed an audiovisual integration task and an audiovisual target-distractor synchronization task using dynamic visual stimuli (a bouncing figure). The groups performed similarly on the audiovisual integration tasks (Experiments 1 and 2). However, in the finger-tapping synchronization task (Experiment 1), musicians were more influenced by auditory distractors when synchronizing to visual sequences, while dancers were more influenced by visual distractors when synchronizing to auditory sequences. When participants synchronized with whole-body movements instead of finger-tapping (Experiment 2), all groups were more influenced by the visual distractor than the auditory distractor. Taken together, this study highlights how training is associated with audiovisual processing, and how different types of visual rhythmic stimuli and different movements alter beat perception and production outcome measures. Implications for the modality appropriateness hypothesis are discussed.
Collapse
Affiliation(s)
- Tram Nguyen
- Brain and Mind Institute and Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - Rebekka Lagacé-Cusiac
- Brain and Mind Institute and Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - J Celina Everling
- Brain and Mind Institute and Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - Molly J Henry
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Department of Psychology, Toronto Metropolitan University, Toronto, Ontario, Canada
| | - Jessica A Grahn
- Brain and Mind Institute and Department of Psychology, University of Western Ontario, London, Ontario, Canada.
| |
Collapse
|
2
|
Naghibi N, Jahangiri N, Khosrowabadi R, Eickhoff CR, Eickhoff SB, Coull JT, Tahmasian M. Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies. Neuropsychol Rev 2024; 34:277-298. [PMID: 36857010 PMCID: PMC10920454 DOI: 10.1007/s11065-023-09588-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 10/05/2022] [Indexed: 03/02/2023]
Abstract
Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.
Collapse
Affiliation(s)
- Narges Naghibi
- Institute for Cognitive and Brain Sciences, Shahid Beheshti University, Tehran, Iran
| | - Nadia Jahangiri
- Faculty of Psychology & Education, Allameh Tabataba'i University, Tehran, Iran
| | - Reza Khosrowabadi
- Institute for Cognitive and Brain Sciences, Shahid Beheshti University, Tehran, Iran
| | - Claudia R Eickhoff
- Institute of Neuroscience and Medicine Research, Structural and functional organisation of the brain (INM-1), Jülich Research Center, Jülich, Germany
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany
| | - Simon B Eickhoff
- Institute of Neuroscience and Medicine Research, Brain and Behaviour (INM-7), Jülich Research Center, Wilhelm-Johnen-Straße, Jülich, Germany
- Institute for Systems Neuroscience, Medical Faculty, Heinrich-Heine University, Düsseldorf, Germany
| | - Jennifer T Coull
- Laboratoire de Neurosciences Cognitives (UMR 7291), Aix-Marseille Université & CNRS, Marseille, France
| | - Masoud Tahmasian
- Institute of Neuroscience and Medicine Research, Brain and Behaviour (INM-7), Jülich Research Center, Wilhelm-Johnen-Straße, Jülich, Germany.
- Institute for Systems Neuroscience, Medical Faculty, Heinrich-Heine University, Düsseldorf, Germany.
| |
Collapse
|
3
|
Melo-Thomas L, Schwarting RKW. Paradoxical kinesia may no longer be a paradox waiting for 100 years to be unraveled. Rev Neurosci 2023; 34:775-799. [PMID: 36933238 DOI: 10.1515/revneuro-2023-0010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Accepted: 02/10/2023] [Indexed: 03/19/2023]
Abstract
Parkinson's disease (PD) is a progressive neurodegenerative disorder mainly characterized by bradykinesia and akinesia. Interestingly, these motor disabilities can depend on the patient emotional state. Disabled PD patients remain able to produce normal motor responses in the context of urgent or externally driven situations or even when exposed to appetitive cues such as music. To describe this phenomenon Souques coined the term "paradoxical kinesia" a century ago. Since then, the mechanisms underlying paradoxical kinesia are still unknown due to a paucity of valid animal models that replicate this phenomenon. To overcome this limitation, we established two animal models of paradoxical kinesia. Using these models, we investigated the neural mechanisms of paradoxical kinesia, with the results pointing to the inferior colliculus (IC) as a key structure. Intracollicular electrical deep brain stimulation, glutamatergic and GABAergic mechanisms may be involved in the elaboration of paradoxical kinesia. Since paradoxical kinesia might work by activation of some alternative pathway bypassing basal ganglia, we suggest the IC as a candidate to be part of this pathway.
Collapse
Affiliation(s)
- Liana Melo-Thomas
- Experimental and Biological Psychology, Behavioral Neuroscience, Faculty of Psychology, Philipps-University of Marburg, Gutenbergstraße 18, 35032 Marburg, Germany
- Marburg Center for Mind, Brain, and Behavior (MCMBB), Hans-Meerwein-Straße 6, 35032 Marburg, Germany
- Behavioral Neurosciences Institute (INeC), Av. do Café, 2450, Monte Alegre, Ribeirão Preto, 14050-220, São Paulo, Brazil
| | - Rainer K W Schwarting
- Experimental and Biological Psychology, Behavioral Neuroscience, Faculty of Psychology, Philipps-University of Marburg, Gutenbergstraße 18, 35032 Marburg, Germany
- Marburg Center for Mind, Brain, and Behavior (MCMBB), Hans-Meerwein-Straße 6, 35032 Marburg, Germany
| |
Collapse
|
4
|
Whitton SA, Jiang F. Sensorimotor synchronization with visual, auditory, and tactile modalities. PSYCHOLOGICAL RESEARCH 2023; 87:2204-2217. [PMID: 36773102 PMCID: PMC10567517 DOI: 10.1007/s00426-023-01801-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Accepted: 01/30/2023] [Indexed: 02/12/2023]
Abstract
While it is well known that humans are highly responsive to rhythm, the factors that influence our ability to synchronize remain unclear. In the current study, we examined how stimulus modality and rhythmic deviation, along with the synchronizer's level of musicality, impacted sensorimotor synchronization (SMS). Utilizing a finger-tapping task and three sensory modalities (visual, auditory, and tactile), we manipulated rhythmic deviation by varying the temporal position, intensity, and availability of cues across four deviation levels. Additionally, to determine our participants' musical familiarity and aptitude, we administered the Goldsmiths Musical Sophistication Index (Gold-MSI) questionnaire. We found that SMS to external rhythmic stimuli was significantly more precise for auditory and tactile than for visual sequences. Further, we found SMS consistency significantly decreased in all modalities with increased rhythmic deviation, suggesting rhythmic deviation directly relates to SMS difficulty. Moreover, a significant correlation was found between Gold-MSI scores and SMS consistency in the most rhythmically deviant level, such that the higher one's musical general sophistication score, the greater one's SMS ability. This held for all three modalities. Combined, these findings suggest that rhythmic synchronization performance is affected not only by the modality and rhythmic deviation of the stimuli but also by the musical general sophistication of the synchronizer.
Collapse
Affiliation(s)
| | - Fang Jiang
- Department of Psychology, University of Nevada, Reno, USA
| |
Collapse
|
5
|
Kang H, Auksztulewicz R, Chan CH, Cappotto D, Rajendran VG, Schnupp JWH. Cross-modal implicit learning of random time patterns. Hear Res 2023; 438:108857. [PMID: 37639922 DOI: 10.1016/j.heares.2023.108857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 07/12/2023] [Accepted: 07/21/2023] [Indexed: 08/31/2023]
Abstract
Perception is sensitive to statistical regularities in the environment, including temporal characteristics of sensory inputs. Interestingly, implicit learning of temporal patterns in one modality can also improve their processing in another modality. However, it is unclear how cross-modal learning transfer affects neural responses to sensory stimuli. Here, we recorded neural activity of human volunteers using electroencephalography (EEG), while participants were exposed to brief sequences of randomly timed auditory or visual pulses. Some trials consisted of a repetition of the temporal pattern within the sequence, and subjects were tasked with detecting these trials. Unknown to the participants, some trials reappeared throughout the experiment across both modalities (Transfer) or only within a modality (Control), enabling implicit learning in one modality and its transfer. Using a novel method of analysis of single-trial EEG responses, we showed that learning temporal structures within and across modalities is reflected in neural learning curves. These putative neural correlates of learning transfer were similar both when temporal information learned in audition was transferred to visual stimuli and vice versa. The modality-specific mechanisms for learning of temporal information and general mechanisms which mediate learning transfer across modalities had distinct physiological signatures: temporal learning within modalities relied on modality-specific brain regions while learning transfer affected beta-band activity in frontal regions.
Collapse
Affiliation(s)
- HiJee Kang
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R; Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Ryszard Auksztulewicz
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R; Center for Cognitive Neuroscience Berlin, Free University Berlin, Berlin, Germany
| | - Chi Hong Chan
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R
| | - Drew Cappotto
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R; UCL Ear Institute, University College London, London, United Kingdom
| | - Vani G Rajendran
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R; Department of Cognitive Neuroscience, Instituto de Neurobiología, Universidad Nacional Autónoma de México, Querétaro, NM
| | - Jan W H Schnupp
- Department of Neuroscience, City University of Hong Kong, Hong Kong S.A.R.
| |
Collapse
|
6
|
Li Y, Ye B, Bao Y. The same phase creates a unique visual rhythm unifying moving elements in time. Psych J 2023; 12:500-506. [PMID: 36916772 DOI: 10.1002/pchj.636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 12/02/2022] [Indexed: 03/16/2023]
Abstract
Attention can be selectively tuned to particular features at different spatial locations or objects. The deployment of attention can be guided by properties, such as color, orientation, and so forth, as guiding features. What might be such guiding features for visual stimuli under dynamic rhythmic conditions? We asked specifically what might be the parameters that attract attention when perceiving a visual rhythm. We used a visual search paradigm, in which a dynamic search display consisted of vertically "bouncing balls" with regular rhythms. The search target was defined by a unique visual rhythm (i.e., with either a shorter or longer period) among rhythmic distractors sharing an identical period. We modulated amplitudes and phases of the distractor balls systematically. The results showed a crucial factor of the phase, not the amplitude. If the phase is violated, the target suddenly "pops out" as an "oddball," showing an efficient parallel search. The findings indicate in general the essential role of the phase in conjunction with amplitude and period for visual rhythm perception. Furthermore, a higher saliency of moving objects with a higher frequency component has also been disclosed.
Collapse
Affiliation(s)
- Yao Li
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, China
| | - Biyi Ye
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Yan Bao
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Institute of Medical Psychology, Ludwig Maximilian University Munich, Munich, Germany
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| |
Collapse
|
7
|
Huang JK, Yin B. Phylogenic evolution of beat perception and synchronization: a comparative neuroscience perspective. Front Syst Neurosci 2023; 17:1169918. [PMID: 37325439 PMCID: PMC10264645 DOI: 10.3389/fnsys.2023.1169918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 05/16/2023] [Indexed: 06/17/2023] Open
Abstract
The study of music has long been of interest to researchers from various disciplines. Scholars have put forth numerous hypotheses regarding the evolution of music. With the rise of cross-species research on music cognition, researchers hope to gain a deeper understanding of the phylogenic evolution, behavioral manifestation, and physiological limitations of the biological ability behind music, known as musicality. This paper presents the progress of beat perception and synchronization (BPS) research in cross-species settings and offers varying views on the relevant hypothesis of BPS. The BPS ability observed in rats and other mammals as well as recent neurobiological findings presents a significant challenge to the vocal learning and rhythm synchronization hypothesis if taken literally. An integrative neural-circuit model of BPS is proposed to accommodate the findings. In future research, it is recommended that greater consideration be given to the social attributes of musicality and to the behavioral and physiological changes that occur across different species in response to music characteristics.
Collapse
Affiliation(s)
- Jin-Kun Huang
- Laboratory for Learning and Behavioral Sciences, School of Psychology, Fujian Normal University, Fuzhou, Fujian, China
| | - Bin Yin
- Laboratory for Learning and Behavioral Sciences, School of Psychology, Fujian Normal University, Fuzhou, Fujian, China
- Department of Applied Psychology, School of Psychology, Fujian Normal University, Fuzhou, Fujian, China
| |
Collapse
|
8
|
Yu CY, Cabildo A, Grahn JA, Vanden Bosch der Nederlanden CM. Perceived rhythmic regularity is greater for song than speech: examining acoustic correlates of rhythmic regularity in speech and song. Front Psychol 2023; 14:1167003. [PMID: 37303916 PMCID: PMC10250601 DOI: 10.3389/fpsyg.2023.1167003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 05/09/2023] [Indexed: 06/13/2023] Open
Abstract
Rhythm is a key feature of music and language, but the way rhythm unfolds within each domain differs. Music induces perception of a beat, a regular repeating pulse spaced by roughly equal durations, whereas speech does not have the same isochronous framework. Although rhythmic regularity is a defining feature of music and language, it is difficult to derive acoustic indices of the differences in rhythmic regularity between domains. The current study examined whether participants could provide subjective ratings of rhythmic regularity for acoustically matched (syllable-, tempo-, and contour-matched) and acoustically unmatched (varying in tempo, syllable number, semantics, and contour) exemplars of speech and song. We used subjective ratings to index the presence or absence of an underlying beat and correlated ratings with stimulus features to identify acoustic metrics of regularity. Experiment 1 highlighted that ratings based on the term "rhythmic regularity" did not result in consistent definitions of regularity across participants, with opposite ratings for participants who adopted a beat-based definition (song greater than speech), a normal-prosody definition (speech greater than song), or an unclear definition (no difference). Experiment 2 defined rhythmic regularity as how easy it would be to tap or clap to the utterances. Participants rated song as easier to clap or tap to than speech for both acoustically matched and unmatched datasets. Subjective regularity ratings from Experiment 2 illustrated that stimuli with longer syllable durations and with less spectral flux were rated as more rhythmically regular across domains. Our findings demonstrate that rhythmic regularity distinguishes speech from song and several key acoustic features can be used to predict listeners' perception of rhythmic regularity within and across domains as well.
Collapse
Affiliation(s)
- Chu Yi Yu
- The Brain and Mind Institute, Western University, London, ON, Canada
- Department of Psychology, Western University, London, ON, Canada
| | - Anne Cabildo
- Department of Psychology, University of Toronto, Mississauga, ON, Canada
| | - Jessica A. Grahn
- The Brain and Mind Institute, Western University, London, ON, Canada
- Department of Psychology, Western University, London, ON, Canada
| | - Christina M. Vanden Bosch der Nederlanden
- The Brain and Mind Institute, Western University, London, ON, Canada
- Department of Psychology, Western University, London, ON, Canada
- Department of Psychology, University of Toronto, Mississauga, ON, Canada
| |
Collapse
|
9
|
Zhan L, Huang Y, Guo Z, Yang J, Gu L, Zhong S, Wu X. Visual over auditory superiority in sensorimotor timing under optimized condition. Front Psychol 2022; 13:1048943. [PMID: 36507012 PMCID: PMC9731274 DOI: 10.3389/fpsyg.2022.1048943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Accepted: 11/04/2022] [Indexed: 11/25/2022] Open
Abstract
Auditory over visual advantage in temporal processing is generally appreciated, such as the well-established auditory superiority in sensorimotor timing. To test for a possible visual superiority in temporal processing, here, we present a data set composed of a large 60 subjects sample and a data set including eight smaller samples of approximately 15 subjects, showing that synchronization to a temporally regular sequence was more stable for a visual bouncing ball (VB) than for auditory tones (ATs). The results demonstrate that vision can be superior over audition in sensorimotor timing under optimized conditions, challenging the generally believed auditory superiority in temporal processing. In contrast to the auditory-specific biological substrates of timing in sensorimotor interaction, the present finding points to tight visual-motor cortical coupling in sensorimotor timing.
Collapse
|
10
|
Exposure to multisensory and visual static or moving stimuli enhances processing of nonoptimal visual rhythms. Atten Percept Psychophys 2022; 84:2655-2669. [PMID: 36241841 PMCID: PMC9630188 DOI: 10.3758/s13414-022-02569-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/05/2022] [Indexed: 11/25/2022]
Abstract
Research has shown that visual moving and multisensory stimuli can efficiently mediate rhythmic information. It is possible, therefore, that the previously reported auditory dominance in rhythm perception is due to the use of nonoptimal visual stimuli. Yet it remains unknown whether exposure to multisensory or visual-moving rhythms would benefit the processing of rhythms consisting of nonoptimal static visual stimuli. Using a perceptual learning paradigm, we tested whether the visual component of the multisensory training pair can affect processing of metric simple two integer-ratio nonoptimal visual rhythms. Participants were trained with static (AVstat), moving-inanimate (AVinan), or moving-animate (AVan) visual stimuli along with auditory tones and a regular beat. In the pre- and posttraining tasks, participants responded whether two static-visual rhythms differed or not. Results showed improved posttraining performance for all training groups irrespective of the type of visual stimulation. To assess whether this benefit was auditory driven, we introduced visual-only training with a moving or static stimulus and a regular beat (Vinan). Comparisons between Vinan and Vstat showed that, even in the absence of auditory information, training with visual-only moving or static stimuli resulted in an enhanced posttraining performance. Overall, our findings suggest that audiovisual and visual static or moving training can benefit processing of nonoptimal visual rhythms.
Collapse
|
11
|
Ono K. Enhancement of visuomotor synchronization by a regular pattern of stimulus presentation. Neurosci Lett 2022; 786:136798. [PMID: 35843470 DOI: 10.1016/j.neulet.2022.136798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Revised: 06/26/2022] [Accepted: 07/11/2022] [Indexed: 11/19/2022]
Abstract
Stable synchronization with external auditory/visual events is important for cooperative behavior, such as playing music in an orchestra. One way to enhance synchronization in the auditory domain is by inserting different tones between tones to synchronize. Synchronized tapping for every other tone or more (1: n tapping) is less variable than that for each tone (1:1 tapping). This phenomenon is called the "subdivision benefit," which is interpreted as that additional temporal references by subdivided tones make synchronization more stable. However, it is unclear whether visuomotor synchronization becomes more stable by subdividing a stimulus sequence. To clarify this, the present study compared 1:3 tapping with a sequence of three-picture patterns and 1:1 tapping with a single picture repetition. When the inter-tap interval (ITI) was 1200 ms or more, the tapping variability showed a subdivision benefit, irrespective of the position of the pictures (1st, 2nd, or 3rd picture) in the three-picture pattern. However, when the ITI was <1000 ms, subdivision did not have any significant effect. These results imply that the subdivision benefit is due to the additional temporal reference provided by the subdivided stimuli, and the benefit depends on the ITI length.
Collapse
Affiliation(s)
- Kentaro Ono
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Japan.
| |
Collapse
|
12
|
Kogutek D, Ready E, Holmes JD, Grahn JA. Synchronization during Improvised Active Music Therapy in clients with Parkinson’s disease. NORDIC JOURNAL OF MUSIC THERAPY 2022. [DOI: 10.1080/08098131.2022.2107054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
Affiliation(s)
- Demian Kogutek
- Faculty of Music, Wilfrid Laurier University, London, ON, Canada
| | - Emily Ready
- Brain and Mind Institute, Western University, London, ON, Canada
| | - Jeffrey D. Holmes
- School of Occupational Therapy, Elborn College, Western University, London, ON, Canada
| | - Jessica A. Grahn
- Department of Psychology and Brain and Mind Institute, Western University, London, ON, Canada
| |
Collapse
|
13
|
Mousavi Z, Kiani MM, Aghajan H. Spatiotemporal Signatures of Surprise Captured by Magnetoencephalography. Front Syst Neurosci 2022; 16:865453. [PMID: 35770244 PMCID: PMC9235820 DOI: 10.3389/fnsys.2022.865453] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 05/24/2022] [Indexed: 11/21/2022] Open
Abstract
Surprise and social influence are linked through several neuropsychological mechanisms. By garnering attention, causing arousal, and motivating engagement, surprise provides a context for effective or durable social influence. Attention to a surprising event motivates the formation of an explanation or updating of models, while high arousal experiences due to surprise promote memory formation. They both encourage engagement with the surprising event through efforts aimed at understanding the situation. By affecting the behavior of the individual or a social group via setting an attractive engagement context, surprise plays an important role in shaping personal and social change. Surprise is an outcome of the brain’s function in constantly anticipating the future of sensory inputs based on past experiences. When new sensory data is different from the brain’s predictions shaped by recent trends, distinct neural signals are generated to report this surprise. As a quantitative approach to modeling the generation of brain surprise, input stimuli containing surprising elements are employed in experiments such as oddball tasks during which brain activity is recorded. Although surprise has been well characterized in many studies, an information-theoretical model to describe and predict the surprise level of an external stimulus in the recorded MEG data has not been reported to date, and setting forth such a model is the main objective of this paper. Through mining trial-by-trial MEG data in an oddball task according to theoretical definitions of surprise, the proposed surprise decoding model employs the entire epoch of the brain response to a stimulus to measure surprise and assesses which collection of temporal/spatial components in the recorded data can provide optimal power for describing the brain’s surprise. We considered three different theoretical formulations for surprise assuming the brain acts as an ideal observer that calculates transition probabilities to estimate the generative distribution of the input. We found that middle temporal components and the right and left fronto-central regions offer the strongest power for decoding surprise. Our findings provide a practical and rigorous method for measuring the brain’s surprise, which can be employed in conjunction with behavioral data to evaluate the interactive and social effects of surprising events.
Collapse
|
14
|
Mårup SH, Møller C, Vuust P. Coordination of voice, hands and feet in rhythm and beat performance. Sci Rep 2022; 12:8046. [PMID: 35577815 PMCID: PMC9110414 DOI: 10.1038/s41598-022-11783-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 04/25/2022] [Indexed: 11/11/2022] Open
Abstract
Interlimb coordination is critical to the successful performance of simple activities in everyday life and it depends on precisely timed perception–action coupling. This is particularly true in music-making, where performers often use body-movements to keep the beat while playing more complex rhythmic patterns. In the current study, we used a musical rhythmic paradigm of simultaneous rhythm/beat performance to examine how interlimb coordination between voice, hands and feet is influenced by the inherent figure-ground relationship between rhythm and beat. Sixty right-handed participants—professional musicians, amateur musicians and non-musicians—performed three short rhythmic patterns while keeping the underlying beat, using 12 different combinations of voice, hands and feet. Results revealed a bodily hierarchy with five levels (1) left foot, (2) right foot, (3) left hand, (4) right hand, (5) voice, i.e., more precise task execution was observed when the rhythm was performed with an effector occupying a higher level in the hierarchy than the effector keeping the beat. The notion of a bodily hierarchy implies that the role assigned to the different effectors is key to successful interlimb coordination: the performance level of a specific effector combination differs considerably, depending on which effector holds the supporting role of the beat and which effector holds the conducting role of the rhythm. Although performance generally increased with expertise, the evidence of the hierarchy was consistent in all three expertise groups. The effects of expertise further highlight how perception influences action. We discuss the possibility that musicians’ more robust metrical prediction models make it easier for musicians to attenuate prediction errors than non-musicians. Overall, the study suggests a comprehensive bodily hierarchy, showing how interlimb coordination is influenced by hierarchical principles in both perception and action.
Collapse
|
15
|
Daniel S, Wimpory D, Delafield-Butt JT, Malloch S, Holck U, Geretsegger M, Tortora S, Osborne N, Schögler B, Koch S, Elias-Masiques J, Howorth MC, Dunbar P, Swan K, Rochat MJ, Schlochtermeier R, Forster K, Amos P. Rhythmic Relating: Bidirectional Support for Social Timing in Autism Therapies. Front Psychol 2022; 13:793258. [PMID: 35693509 PMCID: PMC9186469 DOI: 10.3389/fpsyg.2022.793258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Accepted: 03/23/2022] [Indexed: 11/13/2022] Open
Abstract
We propose Rhythmic Relating for autism: a system of supports for friends, therapists, parents, and educators; a system which aims to augment bidirectional communication and complement existing therapeutic approaches. We begin by summarizing the developmental significance of social timing and the social-motor-synchrony challenges observed in early autism. Meta-analyses conclude the early primacy of such challenges, yet cite the lack of focused therapies. We identify core relational parameters in support of social-motor-synchrony and systematize these using the communicative musicality constructs: pulse; quality; and narrative. Rhythmic Relating aims to augment the clarity, contiguity, and pulse-beat of spontaneous behavior by recruiting rhythmic supports (cues, accents, turbulence) and relatable vitality; facilitating the predictive flow and just-ahead-in-time planning needed for good-enough social timing. From here, we describe possibilities for playful therapeutic interaction, small-step co-regulation, and layered sensorimotor integration. Lastly, we include several clinical case examples demonstrating the use of Rhythmic Relating within four different therapeutic approaches (Dance Movement Therapy, Improvisational Music Therapy, Play Therapy, and Musical Interaction Therapy). These clinical case examples are introduced here and several more are included in the Supplementary Material (Examples of Rhythmic Relating in Practice). A suite of pilot intervention studies is proposed to assess the efficacy of combining Rhythmic Relating with different therapeutic approaches in playful work with individuals with autism. Further experimental hypotheses are outlined, designed to clarify the significance of certain key features of the Rhythmic Relating approach.
Collapse
Affiliation(s)
- Stuart Daniel
- British Association of Play Therapists, London, United Kingdom
| | - Dawn Wimpory
- BCU Health Board (NHS), Bangor, United Kingdom
- School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom
| | - Jonathan T. Delafield-Butt
- Laboratory for Innovation in Autism, University of Strathclyde, Glasgow, United Kingdom
- School of Education, University of Strathclyde, Glasgow, United Kingdom
| | - Stephen Malloch
- Westmead Psychotherapy Program, School of Medicine, University of Sydney, Sydney, NSW, Australia
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, NSW, Australia
| | - Ulla Holck
- Music Therapy, Department of Communication and Psychology, Aalborg University, Aalborg, Denmark
| | - Monika Geretsegger
- The Grieg Academy Music Therapy Research Centre, NORCE Norwegian Research Centre, Bergen, Norway
| | - Suzi Tortora
- Dancing Dialogue, LCAT, New York, NY, United States
| | - Nigel Osborne
- Department of Music, University of Edinburgh, Edinburgh, United Kingdom
| | - Benjaman Schögler
- Perception Movement Action Research Consortium, University of Edinburgh, Edinburgh, United Kingdom
| | - Sabine Koch
- Research Institute for Creative Arts Therapies, Alanus University, Alfter, Germany
- School of Therapy Sciences, Creative Arts Therapies, SRH University Heidelberg, Heidelberg, Germany
| | - Judit Elias-Masiques
- BCU Health Board (NHS), Bangor, United Kingdom
- School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom
| | | | | | - Karrie Swan
- Department of Counseling, Leadership, and Special Education, Missouri State University, Springfield, MO, United States
| | - Magali J. Rochat
- Functional and Molecular Neuroimaging Unit, IRCCS Istituto delle Scienze Neurologiche di Bologna, Bologna, Italy
| | | | - Katharine Forster
- BCU Health Board (NHS), Bangor, United Kingdom
- School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom
| | - Pat Amos
- Independent Researcher, Ardmore, PA, United States
| |
Collapse
|
16
|
Abstract
It is commonly agreed that vision is more sensitive to spatial information, while audition is more sensitive to temporal information. When both visual and auditory information are available simultaneously, the modality appropriateness hypothesis predicts that, depending on the task, the most appropriate (i.e., reliable) modality dominates perception. While previous research mainly focused on discrepant information from different sensory inputs to scrutinize the modality appropriateness hypothesis, the current study aimed at investigating the modality appropriateness hypothesis when multimodal information was provided in a nondiscrepant and simultaneous manner. To this end, participants performed a temporal rhythm reproduction task for which the auditory modality is known to be the most appropriate. The experiment comprised an auditory (i.e., beeps), a visual (i.e., flashing dots), and an audiovisual condition (i.e., beeps and dots simultaneously). Moreover, constant as well as variable interstimulus intervals were implemented. Results revealed higher accuracy and lower variability in the auditory condition for both interstimulus interval types when compared to the visual condition. More importantly, there were no differences between the auditory and the audiovisual condition across both interstimulus interval types. This indicates that the auditory modality dominated multimodal perception in the task, whereas the visual modality was disregarded and hence did not add to reproduction performance.
Collapse
Affiliation(s)
- Alexandra Hildebrandt
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, 9378Friedrich Schiller University Jena, Germany
| | - Eric Grießbach
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, 9378Friedrich Schiller University Jena, Germany
| | - Rouwen Cañal-Bruland
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, 9378Friedrich Schiller University Jena, Germany
| |
Collapse
|
17
|
REPP: A robust cross-platform solution for online sensorimotor synchronization experiments. Behav Res Methods 2022; 54:2271-2285. [PMID: 35149980 PMCID: PMC8853279 DOI: 10.3758/s13428-021-01722-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/06/2021] [Indexed: 11/25/2022]
Abstract
Sensorimotor synchronization (SMS), the rhythmic coordination of perception and action, is a fundamental human skill that supports many behaviors, including music and dance (Repp, 2005; Repp & Su, 2013). Traditionally, SMS experiments have been performed in the laboratory using finger tapping paradigms, and have required equipment with high temporal fidelity to capture the asynchronies between the time of the tap and the corresponding cue event. Thus, SMS is particularly challenging to study with online research, where variability in participants’ hardware and software can introduce uncontrolled latency and jitter into recordings. Here we present REPP (Rhythm ExPeriment Platform), a novel technology for measuring SMS in online experiments that can work efficiently using the built-in microphone and speakers of standard laptop computers. In a series of calibration and behavioral experiments, we demonstrate that REPP achieves high temporal accuracy (latency and jitter within 2 ms on average), high test-retest reliability both in the laboratory (r = .87) and online (r = .80), and high concurrent validity (r = .94). We also show that REPP is fully automated and customizable, enabling researchers to monitor experiments in real time and to implement a wide variety of SMS paradigms. We discuss online methods for ensuring high recruiting efficiency and data quality, including pre-screening tests and automatic procedures for quality monitoring. REPP can therefore open new avenues for research on SMS that would be nearly impossible in the laboratory, reducing experimental costs while massively increasing the reach, scalability, and speed of data collection.
Collapse
|
18
|
Huang Y, Zhong S, Zhan L, Sun M, Wu X. Sustained visual attention improves visuomotor timing. PSYCHOLOGICAL RESEARCH 2022; 86:2059-2066. [PMID: 35048198 DOI: 10.1007/s00426-021-01629-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 12/07/2021] [Indexed: 11/24/2022]
Abstract
Relative to audition, vision is considered much less trustworthy in sensorimotor timing such as synchronizing finger movements with a temporally regular sequence. Visuomotor timing requires maintaining attention over time, whereas the sustained visual attention may not be well held in conventional visuomotor timing task settings where flashing visual stimuli consisted of a briefly presented flash and a long blank period. In the present study, the potential attentional lapses in time due to the disappearance of the flash were carefully controlled in Experiment 1 by changing the color of the flash instead of its disappearance, or in Experiment 2 by adding an additional continuously presented fixation point serving as an external attentional cue when the flash disappeared. Improvement of visuomotor timing performance was found in both experiments. The finding suggests a role of enhanced sustained visual attention in improving visuomotor timing, by which vision could also be a trustworthy modality for processing temporal information in sensorimotor interactions.
Collapse
Affiliation(s)
- Yingyu Huang
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Shengqi Zhong
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Liying Zhan
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Mi Sun
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Xiang Wu
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China.
| |
Collapse
|
19
|
Hoddinott JD, Schuit D, Grahn JA. Comparisons between short-term memory systems for verbal and rhythmic stimuli. Neuropsychologia 2021; 163:108080. [PMID: 34728240 DOI: 10.1016/j.neuropsychologia.2021.108080] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 10/26/2021] [Accepted: 10/29/2021] [Indexed: 11/17/2022]
Abstract
Auditory short-term memory is often conceived of as a unitary capacity, with memory for different auditory materials (such as syllables, pitches, rhythms) posited to rely on similar neural mechanisms. One spontaneous behavior observed in short-term memory studies is 'chunking'. For example, individuals often recount digit sequences in groups, or chunks, of 3-4 digits, and chunking is associated with better performance. Chunking may also operate in musical rhythm, with beats acting as potential chunk boundaries for tones in rhythmic sequences. Similar to chunking, beat-based structure in rhythms also improves performance. Thus, it is possible that beat processing relies on the same mechanisms that underlie chunking of verbal material. The current fMRI study examined whether beat perception is indeed a type of chunking, measuring brain responses to chunked and 'unchunked' letter sequences relative to beat-based and non-beat-based rhythmic sequences. Participants completed a sequence discrimination task, and comparisons between stimulus encoding, maintenance, and discrimination were made for both rhythmic and verbal sequences. Overall, rhythm and verbal short-term memory networks overlapped substantially. When contrasting rhythmic and verbal conditions, rhythms activated basal ganglia, supplementary motor area, and anterior insula more than letter strings did, during both encoding and discrimination. Verbal letter strings activated bilateral auditory cortex more than rhythms did during encoding, and parietal cortex, precuneus, and middle frontal gyri more than rhythms did during discrimination. Importantly, there was a significant interaction in the basal ganglia during encoding: activation for beat-based rhythms was greater than for non-beat-based rhythms, but verbal chunked and unchunked conditions did not differ. The interaction indicates that beat perception is not simply a case of chunking, suggesting a dissociation between beat processing and chunking-based grouping mechanisms.
Collapse
Affiliation(s)
- Joshua D Hoddinott
- Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada; Neuroscience Program, University of Western Ontario, London, Ontario, Canada
| | - Dirk Schuit
- Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
| | - Jessica A Grahn
- Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada; Department of Psychology, University of Western Ontario, London, Ontario Canada.
| |
Collapse
|
20
|
Lagarrigue Y, Cappe C, Tallet J. Regular rhythmic and audio-visual stimulations enhance procedural learning of a perceptual-motor sequence in healthy adults: A pilot study. PLoS One 2021; 16:e0259081. [PMID: 34780497 PMCID: PMC8592429 DOI: 10.1371/journal.pone.0259081] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Accepted: 10/12/2021] [Indexed: 12/02/2022] Open
Abstract
Procedural learning is essential for the effortless execution of many everyday life activities. However, little is known about the conditions influencing the acquisition of procedural skills. The literature suggests that sensory environment may influence the acquisition of perceptual-motor sequences, as tested by a Serial Reaction Time Task. In the current study, we investigated the effects of auditory stimulations on procedural learning of a visuo-motor sequence. Given that the literature shows that regular rhythmic auditory rhythm and multisensory stimulations improve motor speed, we expected to improve procedural learning (reaction times and errors) with repeated practice with auditory stimulations presented either simultaneously with visual stimulations or with a regular tempo, compared to control conditions (e.g., with irregular tempo). Our results suggest that both congruent audio-visual stimulations and regular rhythmic auditory stimulations promote procedural perceptual-motor learning. On the contrary, auditory stimulations with irregular or very quick tempo alter learning. We discuss how regular rhythmic multisensory stimulations may improve procedural learning with respect of a multisensory rhythmic integration process.
Collapse
Affiliation(s)
- Yannick Lagarrigue
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
- * E-mail:
| | - Céline Cappe
- Cerco, Centre de Recherche Cerveau et Cognition, Université de Toulouse, CNRS, UMR 5549, Toulouse, France
| | - Jessica Tallet
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| |
Collapse
|
21
|
Planton S, Dehaene S. Cerebral representation of sequence patterns across multiple presentation formats. Cortex 2021; 145:13-36. [PMID: 34673292 DOI: 10.1016/j.cortex.2021.09.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Revised: 08/06/2021] [Accepted: 09/01/2021] [Indexed: 01/29/2023]
Abstract
The ability to detect the abstract pattern underlying a temporal sequence of events is crucial to many human activities, including language and mathematics, but its cortical correlates remain poorly understood. It is also unclear whether repeated exposure to the same sequence of sensory stimuli is sufficient to induce the encoding of an abstract amodal representation of the pattern. Using functional MRI, we probed the existence of such abstract codes for sequential patterns, their localization in the human brain, and their relation to existing language and math-responsive networks. We used a passive sequence violation paradigm, in which a given sequence is repeatedly presented before rare deviant sequences are introduced. We presented two binary patterns, AABB and ABAB, in four presentation formats, either visual or auditory, and either cued by the identity of the stimuli or by their spatial location. Regardless of the presentation format, a habituation to the repeated pattern and a response to pattern violations were seen in a set of inferior frontal, intraparietal and temporal areas. Within language areas, such pattern-violation responses were only found in the inferior frontal gyrus (IFG), whereas all math-responsive regions responded to pattern changes. Most of these regions also responded whenever the modality or the cue changed, suggesting a general sensitivity to violation detection. Thus, the representation of sequence patterns appears to be distributed, yet to include a core set of abstract amodal regions, particularly the IFG.
Collapse
Affiliation(s)
- Samuel Planton
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France.
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France; Collège de France, Université PSL Paris Sciences Lettres, Paris, France
| |
Collapse
|
22
|
Patel AD. Vocal learning as a preadaptation for the evolution of human beat perception and synchronization. Philos Trans R Soc Lond B Biol Sci 2021; 376:20200326. [PMID: 34420384 PMCID: PMC8380969 DOI: 10.1098/rstb.2020.0326] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/18/2021] [Indexed: 12/18/2022] Open
Abstract
The human capacity to synchronize movements to an auditory beat is central to musical behaviour and to debates over the evolution of human musicality. Have humans evolved any neural specializations for music processing, or does music rely entirely on brain circuits that evolved for other reasons? The vocal learning and rhythmic synchronization hypothesis proposes that our ability to move in time with an auditory beat in a precise, predictive and tempo-flexible manner originated in the neural circuitry for complex vocal learning. In the 15 years, since the hypothesis was proposed a variety of studies have supported it. However, one study has provided a significant challenge to the hypothesis. Furthermore, it is increasingly clear that vocal learning is not a binary trait animals have or lack, but varies more continuously across species. In the light of these developments and of recent progress in the neurobiology of beat processing and of vocal learning, the current paper revises the vocal learning hypothesis. It argues that an advanced form of vocal learning acts as a preadaptation for sporadic beat perception and synchronization (BPS), providing intrinsic rewards for predicting the temporal structure of complex acoustic sequences. It further proposes that in humans, mechanisms of gene-culture coevolution transformed this preadaptation into a genuine neural adaptation for sustained BPS. The larger significance of this proposal is that it outlines a hypothesis of cognitive gene-culture coevolution which makes testable predictions for neuroscience, cross-species studies and genetics. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.
Collapse
Affiliation(s)
- Aniruddh D. Patel
- Department of Psychology, Tufts University, Medford, MA, USA
- Program in Brain, Mind, and Consciousness, Canadian Institute for Advanced Research, Toronto, Canada
| |
Collapse
|
23
|
A simple and cheap setup for timing tapping responses synchronized to auditory stimuli. Behav Res Methods 2021; 54:712-728. [PMID: 34346040 DOI: 10.3758/s13428-021-01653-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/15/2021] [Indexed: 11/08/2022]
Abstract
Measuring human capabilities to synchronize in time, adapt to perturbations to timing sequences, or reproduce time intervals often requires experimental setups that allow recording response times with millisecond precision. Most setups present auditory stimuli using either MIDI devices or specialized hardware such as Arduino and are often expensive or require calibration and advanced programming skills. Here, we present in detail an experimental setup that only requires an external sound card and minor electronic skills, works on a conventional PC, is cheaper than alternatives, and requires almost no programming skills. It is intended for presenting any auditory stimuli and recording tapping response times with within 2-ms precision (up to - 2 ms lag). This paper shows why desired accuracy in recording response times against auditory stimuli is difficult to achieve in conventional computer setups, presents an experimental setup to overcome this, and explains in detail how to set it up and use the provided code. Finally, the code for analyzing the recorded tapping responses was evaluated, showing that no spurious or missing events were found in 94% of the analyzed recordings.
Collapse
|
24
|
Tierney A, Gomez JC, Fedele O, Kirkham NZ. Reading ability in children relates to rhythm perception across modalities. J Exp Child Psychol 2021; 210:105196. [PMID: 34090237 DOI: 10.1016/j.jecp.2021.105196] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 03/02/2021] [Accepted: 05/03/2021] [Indexed: 10/21/2022]
Abstract
The onset of reading ability is rife with individual differences, with some children termed "early readers" and some falling behind from the very beginning. Reading skill in children has been linked to an ability to remember nonverbal rhythms, specifically in the auditory modality. It has been hypothesized that the link between rhythm skills and reading reflects a shared reliance on the ability to extract temporal structure from sound. Here we tested this hypothesis by investigating whether the link between rhythm memory and reading depends on the modality in which rhythms are presented. We tested 75 primary school-aged children aged 7-11 years on a within-participants battery of reading and rhythm tasks. Participants received a reading efficiency task followed by three rhythm tasks (auditory, visual, and audiovisual). Results showed that children who performed poorly on the reading task also performed poorly on the tasks that required them to remember and repeat back nonverbal rhythms. In addition, these children showed a rhythmic deficit not just in the auditory domain but also in the visual domain. However, auditory rhythm memory explained additional variance in reading ability even after controlling for visual memory. These results suggest that reading ability and rhythm memory rely both on shared modality-general cognitive processes and on the ability to perceive the temporal structure of sound.
Collapse
Affiliation(s)
- Adam Tierney
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, UK.
| | - Jessica Cardona Gomez
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, UK
| | - Oliver Fedele
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, UK
| | - Natasha Z Kirkham
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, UK.
| |
Collapse
|
25
|
Nijhuis P, Keller PE, Nozaradan S, Varlet M. Dynamic modulation of cortico-muscular coupling during real and imagined sensorimotor synchronisation. Neuroimage 2021; 238:118209. [PMID: 34051354 DOI: 10.1016/j.neuroimage.2021.118209] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Revised: 04/19/2021] [Accepted: 05/10/2021] [Indexed: 12/20/2022] Open
Abstract
People have a natural and intrinsic ability to coordinate body movements with rhythms surrounding them, known as sensorimotor synchronisation. This can be observed in daily environments, when dancing or singing along with music, or spontaneously walking, talking or applauding in synchrony with one another. However, the neurophysiological mechanisms underlying accurately synchronised movement with selected rhythms in the environment remain unclear. Here we studied real and imagined sensorimotor synchronisation with interleaved auditory and visual rhythms using cortico-muscular coherence (CMC) to better understand the processes underlying the preparation and execution of synchronised movement. Electroencephalography (EEG), electromyography (EMG) from the finger flexors, and continuous force signals were recorded in 20 participants during tapping and imagined tapping with discrete stimulus sequences consisting of alternating auditory beeps and visual flashes. The results show that the synchronisation between cortical and muscular activity in the beta (14-38 Hz) frequency band becomes time-locked to the taps executed in synchrony with the visual and auditory stimuli. Dynamic modulation in CMC also occurred when participants imagined tapping with the visual stimuli, but with lower amplitude and a different temporal profile compared to real tapping. These results suggest that CMC does not only reflect changes related to the production of the synchronised movement, but also to its preparation, which appears heightened under higher attentional demands imposed when synchronising with the visual stimuli. These findings highlight a critical role of beta band neural oscillations in the cortical-muscular coupling underlying sensorimotor synchronisation.
Collapse
Affiliation(s)
- Patti Nijhuis
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
| | - Sylvie Nozaradan
- Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia; School of Psychology, Western Sydney University, Sydney, Australia
| |
Collapse
|
26
|
Benedetto A, Baud-Bovy G. Tapping Force Encodes Metrical Aspects of Rhythm. Front Hum Neurosci 2021; 15:633956. [PMID: 33986651 PMCID: PMC8111927 DOI: 10.3389/fnhum.2021.633956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 03/26/2021] [Indexed: 11/13/2022] Open
Abstract
Humans possess the ability to extract highly organized perceptual structures from sequences of temporal stimuli. For instance, we can organize specific rhythmical patterns into hierarchical, or metrical, systems. Despite the evidence of a fundamental influence of the motor system in achieving this skill, few studies have attempted to investigate the organization of our motor representation of rhythm. To this aim, we studied-in musicians and non-musicians-the ability to perceive and reproduce different rhythms. In a first experiment participants performed a temporal order-judgment task, for rhythmical sequences presented via auditory or tactile modality. In a second experiment, they were asked to reproduce the same rhythmic sequences, while their tapping force and timing were recorded. We demonstrate that tapping force encodes the metrical aspect of the rhythm, and the strength of the coding correlates with the individual's perceptual accuracy. We suggest that the similarity between perception and tapping-force organization indicates a common representation of rhythm, shared between the perceptual and motor systems.
Collapse
Affiliation(s)
| | - Gabriel Baud-Bovy
- Robotics, Brain and Cognitive Science Unit, Italian Institute of Technology, Genoa, Italy
- Faculty of Psychology, Vita-Salute San Raffaele University, Milan, Italy
| |
Collapse
|
27
|
Blais M, Jucla M, Maziero S, Albaret JM, Chaix Y, Tallet J. The Differential Effects of Auditory and Visual Stimuli on Learning, Retention and Reactivation of a Perceptual-Motor Temporal Sequence in Children With Developmental Coordination Disorder. Front Hum Neurosci 2021; 15:616795. [PMID: 33867955 PMCID: PMC8044544 DOI: 10.3389/fnhum.2021.616795] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 03/03/2021] [Indexed: 11/13/2022] Open
Abstract
This study investigates the procedural learning, retention, and reactivation of temporal sensorimotor sequences in children with and without developmental coordination disorder (DCD). Twenty typically-developing (TD) children and 12 children with DCD took part in this study. The children were required to tap on a keyboard, synchronizing with auditory or visual stimuli presented as an isochronous temporal sequence, and practice non-isochronous temporal sequences to memorize them. Immediate and delayed retention of the audio-motor and visuo-motor non-isochronous sequences were tested by removing auditory or visual stimuli immediately after practice and after a delay of 2 h. A reactivation test involved reintroducing the auditory and visual stimuli after the delayed recall. Data were computed via circular analyses to obtain asynchrony, the stability of synchronization and errors (i.e., the number of supplementary taps). Firstly, an overall deficit in synchronization with both auditory and visual isochronous stimuli was observed in DCD children compared to TD children. During practice, further improvements (decrease in asynchrony and increase in stability) were found for the audio-motor non-isochronous sequence compared to the visuo-motor non-isochronous sequence in both TD children and children with DCD. However, a drastic increase in errors occurred in children with DCD during immediate retention as soon as the auditory stimuli were removed. Reintroducing auditory stimuli decreased errors in the audio-motor sequence for children with DCD. Such changes were not seen for the visuo-motor non-isochronous sequence, which was equally learned, retained and reactivated in DCD and TD children. All these results suggest that TD children benefit from both auditory and visual stimuli to memorize the sequence, whereas children with DCD seem to present a deficit in integrating an audio-motor sequence in their memory. The immediate effect of reactivation suggests a specific dependency on auditory information in DCD. Contrary to the audio-motor sequence, the visuo-motor sequence was both learned and retained in children with DCD. This suggests that visual stimuli could be the best information for memorizing a temporal sequence in DCD. All these results are discussed in terms of a specific audio-motor coupling deficit in DCD.
Collapse
Affiliation(s)
- Mélody Blais
- Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France
| | - Mélanie Jucla
- Octogone-Lordat, University of Toulouse, Toulouse, France
| | - Stéphanie Maziero
- Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
- Octogone-Lordat, University of Toulouse, Toulouse, France
| | - Jean-Michel Albaret
- Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Yves Chaix
- Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
- Hôpital des Enfants, Centre Hospitalier Universitaire de Toulouse, CHU Purpan, Toulouse, France
| | - Jessica Tallet
- Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| |
Collapse
|
28
|
Espinoza-Monroy M, de Lafuente V. Discrimination of Regular and Irregular Rhythms Explained by a Time Difference Accumulation Model. Neuroscience 2021; 459:16-26. [PMID: 33549694 DOI: 10.1016/j.neuroscience.2021.01.035] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Revised: 01/20/2021] [Accepted: 01/28/2021] [Indexed: 02/07/2023]
Abstract
Perceiving the temporal regularity in a sequence of repetitive sensory events facilitates the preparation and execution of relevant behaviors with tight temporal constraints. How we estimate temporal regularity from repeating patterns of sensory stimuli is not completely understood. We developed a decision-making task in which participants had to decide whether a train of visual, auditory, or tactile pulses, had a regular or an irregular temporal pattern. We tested the hypothesis that subjects categorize stimuli as irregular by accumulating the time differences between the predicted and observed times of sensory pulses defining a temporal rhythm. Results suggest that instead of waiting for a single large temporal deviation, participants accumulate timing-error signals and judge a pattern as irregular when the amount of evidence reaches a decision threshold. Model fits of bounded integration showed that this accumulation occurs with negligible leak of evidence. Consistent with previous findings, we show that participants perform better when evaluating the regularity of auditory pulses, as compared with visual or tactile stimuli. Our results suggest that temporal regularity is estimated by comparing expected and measured pulse onset times, and that each prediction error is accumulated towards a threshold to generate a behavioral choice.
Collapse
Affiliation(s)
- Marisol Espinoza-Monroy
- Instituto de Neurobiología, Universidad Nacional Autónoma de México, Querétaro, QRO 76230, Mexico
| | - Victor de Lafuente
- Instituto de Neurobiología, Universidad Nacional Autónoma de México, Querétaro, QRO 76230, Mexico.
| |
Collapse
|
29
|
Gilmore SA, Russo FA. Neural and Behavioral Evidence for Vibrotactile Beat Perception and Bimodal Enhancement. J Cogn Neurosci 2021; 33:635-650. [PMID: 33475449 DOI: 10.1162/jocn_a_01673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The ability to synchronize movements to a rhythmic stimulus, referred to as sensorimotor synchronization (SMS), is a behavioral measure of beat perception. Although SMS is generally superior when rhythms are presented in the auditory modality, recent research has demonstrated near-equivalent SMS for vibrotactile presentations of isochronous rhythms [Ammirante, P., Patel, A. D., & Russo, F. A. Synchronizing to auditory and tactile metronomes: A test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23, 1882-1890, 2016]. The current study aimed to replicate and extend this study by incorporating a neural measure of beat perception. Nonmusicians were asked to tap to rhythms or to listen passively while EEG data were collected. Rhythmic complexity (isochronous, nonisochronous) and presentation modality (auditory, vibrotactile, bimodal) were fully crossed. Tapping data were consistent with those observed by Ammirante et al. (2016), revealing near-equivalent SMS for isochronous rhythms across modality conditions and a drop-off in SMS for nonisochronous rhythms, especially in the vibrotactile condition. EEG data revealed a greater degree of neural entrainment for isochronous compared to nonisochronous trials as well as for auditory and bimodal compared to vibrotactile trials. These findings led us to three main conclusions. First, isochronous rhythms lead to higher levels of beat perception than nonisochronous rhythms across modalities. Second, beat perception is generally enhanced for auditory presentations of rhythm but still possible under vibrotactile presentation conditions. Finally, exploratory analysis of neural entrainment at harmonic frequencies suggests that beat perception may be enhanced for bimodal presentations of rhythm.
Collapse
|
30
|
Planton S, van Kerkoerle T, Abbih L, Maheu M, Meyniel F, Sigman M, Wang L, Figueira S, Romano S, Dehaene S. A theory of memory for binary sequences: Evidence for a mental compression algorithm in humans. PLoS Comput Biol 2021; 17:e1008598. [PMID: 33465081 PMCID: PMC7845997 DOI: 10.1371/journal.pcbi.1008598] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 01/29/2021] [Accepted: 12/01/2020] [Indexed: 01/29/2023] Open
Abstract
Working memory capacity can be improved by recoding the memorized information in a condensed form. Here, we tested the theory that human adults encode binary sequences of stimuli in memory using an abstract internal language and a recursive compression algorithm. The theory predicts that the psychological complexity of a given sequence should be proportional to the length of its shortest description in the proposed language, which can capture any nested pattern of repetitions and alternations using a limited number of instructions. Five experiments examine the capacity of the theory to predict human adults' memory for a variety of auditory and visual sequences. We probed memory using a sequence violation paradigm in which participants attempted to detect occasional violations in an otherwise fixed sequence. Both subjective complexity ratings and objective violation detection performance were well predicted by our theoretical measure of complexity, which simply reflects a weighted sum of the number of elementary instructions and digits in the shortest formula that captures the sequence in our language. While a simpler transition probability model, when tested as a single predictor in the statistical analyses, accounted for significant variance in the data, the goodness-of-fit with the data significantly improved when the language-based complexity measure was included in the statistical model, while the variance explained by the transition probability model largely decreased. Model comparison also showed that shortest description length in a recursive language provides a better fit than six alternative previously proposed models of sequence encoding. The data support the hypothesis that, beyond the extraction of statistical knowledge, human sequence coding relies on an internal compression using language-like nested structures.
Collapse
Affiliation(s)
- Samuel Planton
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
| | - Timo van Kerkoerle
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
| | - Leïla Abbih
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
| | - Maxime Maheu
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
- Université de Paris, Paris, France
| | - Florent Meyniel
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
| | - Mariano Sigman
- Laboratorio de Neurociencia, Universidad Torcuato Di Tella, Buenos Aires, Argentina
- CONICET (Consejo Nacional de Investigaciones Científicas y Tecnicas), Buenos Aires, Argentina
- Facultad de Lenguas y Educacion, Universidad Nebrija, Madrid, Spain
| | - Liping Wang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Santiago Figueira
- CONICET (Consejo Nacional de Investigaciones Científicas y Tecnicas), Buenos Aires, Argentina
- Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales, Departamento de Computacion, Buenos Aires, Argentina
| | - Sergio Romano
- CONICET (Consejo Nacional de Investigaciones Científicas y Tecnicas), Buenos Aires, Argentina
- Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales, Departamento de Computacion, Buenos Aires, Argentina
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, CEA, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France
- Collège de France, Paris, France
| |
Collapse
|
31
|
Miguel MA, Sigman M, Fernandez Slezak D. From beat tracking to beat expectation: Cognitive-based beat tracking for capturing pulse clarity through time. PLoS One 2020; 15:e0242207. [PMID: 33206697 PMCID: PMC7673539 DOI: 10.1371/journal.pone.0242207] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Accepted: 10/28/2020] [Indexed: 11/29/2022] Open
Abstract
Pulse is the base timing to which western music is commonly notated, generally expressed by a listener by performing periodic taps with their hand or foot. This cognitive construction helps organize the perception of timed events in music and is the most basic expectation in rhythms. The analysis of expectations, and more specifically the strength with which the beat is felt-the pulse clarity-has been used to analyze affect in music. Most computational models of pulse clarity, and rhythmic expectation in general, analyze the input as a whole, without exhibiting changes through a rhythmic passage. We present Tactus Hypothesis Tracker (THT), a model of pulse clarity over time intended for symbolic rhythmic stimuli. The model was developed based on ideas of beat tracking models that extract beat times from musical stimuli. Our model also produces possible beat interpretations for the rhythm, a fitness score for each interpretation and how these evolve in time. We evaluated the model's pulse clarity by contrasting against tapping variability of human annotators achieving results comparable to a state-of-the-art pulse clarity model. We also analyzed the clarity metric dynamics on synthetic data that introduced changes in the beat, showing that our model presented doubt in the pulse estimation process and adapted accordingly to beat changes. Finally, we assessed if the beat tracking generated by the model was correct regarding listeners tapping data. We compared our beat tracking results with previous beat tracking models. The THT model beat tracking output showed generally correct estimations in phase but exhibits a bias towards a musically correct subdivision of the beat.
Collapse
Affiliation(s)
- Martin Alejandro Miguel
- Laboratorio de Inteligencia Artificial Aplicada, Departamento de Computación, Universidad de Buenos Aires, Buenos Aires, Argentina
- Instituto de Investigación en Ciencias de la Computación (ICC), CONICET-Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Mariano Sigman
- Laboratorio de Neurociencia, Universidad Torcuato Di Tella, Buenos Aires, Argentina
- Consejo Nacional de Investigaciones Centóficas y Técnicas (CONICET), Buenos Aires, Argentina
- Facultad de Lenguas y Educación, Universidad Nebrija, Madrid, Spain
| | - Diego Fernandez Slezak
- Laboratorio de Inteligencia Artificial Aplicada, Departamento de Computación, Universidad de Buenos Aires, Buenos Aires, Argentina
- Instituto de Investigación en Ciencias de la Computación (ICC), CONICET-Universidad de Buenos Aires, Buenos Aires, Argentina
| |
Collapse
|
32
|
Synchronization to auditory and visual beats in Parkinson's disease. Parkinsonism Relat Disord 2020; 79:47-54. [PMID: 32862018 DOI: 10.1016/j.parkreldis.2020.08.029] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Revised: 08/18/2020] [Accepted: 08/21/2020] [Indexed: 11/23/2022]
Abstract
The ability to move in synchrony with a perceived regular beat in time is essential for humans to interact with environments in an anticipatory manner, and the basal ganglia have been shown to be preferentially involved in beat processing. Auditory beats are often adopted in assessing the sensorimotor deficiency of patients with Parkinson's disease (PD), which is characterized by basal ganglia dysfunction. Whereas beat synchronization has long been considered to be specific to the auditory modality, recent studies employing moving instead of static visual stimuli have shown comparable synchronization performances of auditory and visual beats. Here, we show that compared with control subjects, synchronization stability of PD patients significantly decreased for beats composed of visual contracting rings but not for beats consisting of auditory tones or static visual flashes. The results revealed specific impairment of visual beat synchronization in PD. Considering the common experience of visuomotor interactions in daily lives of PD patients, the present finding emphasizes the importance of evaluation of visuomotor timing deficiency in PD by employing moving visual stimuli that have ecological relevance.
Collapse
|
33
|
Lê M, Blais M, Jucla M, Chauveau N, Maziero S, Biotteau M, Albaret JM, Péran P, Chaix Y, Tallet J. Procedural learning and retention of audio-verbal temporal sequence is altered in children with developmental coordination disorder but cortical thickness matters. Dev Sci 2020; 24:e13009. [PMID: 32573893 DOI: 10.1111/desc.13009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Revised: 04/13/2020] [Accepted: 06/11/2020] [Indexed: 12/21/2022]
Abstract
Rhythmic abilities are impaired in developmental coordination disorder (DCD) but learning deficit of procedural skills implying temporal sequence is still unclear. Current contradictory results suggest that procedural learning deficits in DCD highly depend on learning conditions. The present study proposes to test the role of sensory modality of stimulations (visual or auditory) on synchronization, learning, and retention of temporal verbal sequences in children with and without DCD. We postulated a deficit in learning particularly with auditory stimulations, in association with atypical cortical thickness of three regions of interesting: sensorimotor, frontal and parietal regions. Thirty children with and without DCD (a) performed a synchronization task to a regular temporal sequence and (b) practiced and recalled a novel non-regular temporal sequences with auditory and visual modalities. They also had a magnetic resonance imaging to measure their cortical thickness. Results suggested that children with DCD presented a general deficit in synchronization of a regular temporal verbal sequence irrespective of the sensory modality, but a specific deficit in learning and retention of auditory non-regular verbal temporal sequence. Stability of audio-verbal synchronization during practice correlated with cortical thickness of the sensorimotor cortex. For the first time, our results suggest that synchronization deficits in DCD are not limited to manual tasks. This deficit persists despite repeated exposition and practice of an auditory temporal sequence, which suggests a possible alteration in audio-verbal coupling in DCD. On the contrary, control of temporal parameters with visual stimuli seems to be less affected, which opens perspectives for clinical practice.
Collapse
Affiliation(s)
- Margaux Lê
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Mélody Blais
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Mélanie Jucla
- Octogone-Lordat, University of Toulouse, Toulouse, France
| | - Nicolas Chauveau
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Stéphanie Maziero
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France.,Octogone-Lordat, University of Toulouse, Toulouse, France
| | - Maëlle Biotteau
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Jean-Michel Albaret
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Patrice Péran
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| | - Yves Chaix
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France.,Hôpital des Enfants Universitaire de Toulouse, CHU Purpan Toulouse, Midi-Pyrénées, France
| | - Jessica Tallet
- ToNIC, Toulouse NeuroImaging Center, Université de Toulouse, Inserm, UPS, Toulouse, France
| |
Collapse
|
34
|
Villalonga MB, Sussman RF, Sekuler R. Feeling the Beat (and Seeing It, Too): Vibrotactile, Visual, and Bimodal Rate Discrimination. Multisens Res 2020; 33:31-59. [PMID: 31648198 DOI: 10.1163/22134808-20191413] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2019] [Accepted: 07/09/2019] [Indexed: 11/19/2022]
Abstract
Beats are among the basic units of perceptual experience. Produced by regular, intermittent stimulation, beats are most commonly associated with audition, but the experience of a beat can result from stimulation in other modalities as well. We studied the robustness of visual, vibrotactile, and bimodal signals as sources of beat perception. Subjects attempted to discriminate between pulse trains delivered at 3 Hz or at 6 Hz. To investigate signal robustness, we intentionally degraded signals on two-thirds of the trials using temporal-domain noise. On these trials, inter-pulse intervals (IPIs) were stochastic, perturbed independently from the nominal IPI by random samples from zero-mean Gaussian distributions with different variances. These perturbations produced directional changes in the IPIs, which either increased or decreased the likelihood of confusing the two pulse rates. In addition to affording an assay of signal robustness, this paradigm made it possible to gauge how subjects' judgments were influenced by successive IPIs. Logistic regression revealed a strong primacy effect: subjects' decisions were disproportionately influenced by a trial's initial IPIs. Response times and parameter estimates from drift-diffusion modeling showed that information accumulates more rapidly with bimodal stimulation than with either unimodal stimulus alone. Analysis of error rates within each condition suggested consistently optimal decision making, even with increased IPI variability. Finally, beat information delivered by vibrotactile signals proved just as robust as information conveyed by visual signals, confirming vibrotactile stimulation's potential as a communication channel.
Collapse
Affiliation(s)
| | - Rachel F Sussman
- 2Volen National Center for Complex Systems, Brandeis University, Waltham, MA, USA
| | - Robert Sekuler
- 2Volen National Center for Complex Systems, Brandeis University, Waltham, MA, USA
| |
Collapse
|
35
|
Elbaz A, Yeshurun Y. Can rhythm-induced attention improve the perceptual representation? PLoS One 2020; 15:e0231200. [PMID: 32298272 PMCID: PMC7162507 DOI: 10.1371/journal.pone.0231200] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 03/18/2020] [Indexed: 11/28/2022] Open
Abstract
Temporal attention can be entrained exogenously to rhythms. Indeed, faster and more accurate responses were previously found when the target appeared in-phase with a preceding rhythm in comparison to when it was out of phase. However, the nature of this rhythm-induced attentional effect is not well understood. To better understand the processes underlying rhythm-induced attention, we employed a continuous measure of perceived orientation and a mixture-model analysis. A trial in our study started with a sequence of auditory beeps separated by a fixed inter-beeps interval in the regular (rhythmic) condition or by variable inter-beeps intervals in the irregular condition. A visual target–a line embedded in a circle–followed the sequence. The ‘critical’ interval between the last beep and the target was chosen randomly from several possible Inter-Onset Intervals (IOIs), of which only one was in-phase with the rhythm. The target was followed by a probe line, and the participants were asked to rotate it to reproduce the target’s orientation. The measure of performance for a given trial was the difference in degrees between the orientation of the target and that reproduced by the observer. We found that guessing rate was lower with regular than irregular rhythms. However, there was no effect of rhythm type (regular vs irregular) on the quality of representation (measured as the variability in reproducing the target). Furthermore, the rhythm effect was present only when rhythm type was fixed within a block, and it was found with all IOIs, not just the in-phase IOI. This lack of specificity suggests that these results reflect a general effect of rhythm on alertness.
Collapse
Affiliation(s)
- Asaf Elbaz
- Department of Psychology & Institute of Information Processing and Decision Making, University of Haifa, Mount Carmel, Haifa, Israel
- * E-mail:
| | - Yaffa Yeshurun
- Department of Psychology & Institute of Information Processing and Decision Making, University of Haifa, Mount Carmel, Haifa, Israel
| |
Collapse
|
36
|
Zalta A, Petkoski S, Morillon B. Natural rhythms of periodic temporal attention. Nat Commun 2020; 11:1051. [PMID: 32103014 PMCID: PMC7044316 DOI: 10.1038/s41467-020-14888-8] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Accepted: 02/06/2020] [Indexed: 12/04/2022] Open
Abstract
That attention is a fundamentally rhythmic process has recently received abundant empirical evidence. The essence of temporal attention, however, is to flexibly focus in time. Whether this function is constrained by an underlying rhythmic neural mechanism is unknown. In six interrelated experiments, we behaviourally quantify the sampling capacities of periodic temporal attention during auditory or visual perception. We reveal the presence of limited attentional capacities, with an optimal sampling rate of ~1.4 Hz in audition and ~0.7 Hz in vision. Investigating the motor contribution to temporal attention, we show that it scales with motor rhythmic precision, maximal at ~1.7 Hz. Critically, motor modulation is beneficial to auditory but detrimental to visual temporal attention. These results are captured by a computational model of coupled oscillators, that reveals the underlying structural constraints governing the temporal alignment between motor and attention fluctuations.
Collapse
Affiliation(s)
- Arnaud Zalta
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France
- APHM, INSERM, Inst Neurosci Syst, Service de Pharmacologie Clinique et Pharmacovigilance, Aix Marseille University, 13005, Marseille, France
| | - Spase Petkoski
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France
| | - Benjamin Morillon
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France.
| |
Collapse
|
37
|
Cued Memory Reactivation during Motor Imagery Practice Influences Early Improvement of Procedural Skill Learning. Neuroscience 2019; 418:244-253. [PMID: 31491503 DOI: 10.1016/j.neuroscience.2019.08.047] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Revised: 08/22/2019] [Accepted: 08/27/2019] [Indexed: 02/05/2023]
|
38
|
Meditation music improved the quality of suturing in an experimental bypass procedure. Acta Neurochir (Wien) 2019; 161:1515-1521. [PMID: 31227967 DOI: 10.1007/s00701-019-03976-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Accepted: 06/05/2019] [Indexed: 12/30/2022]
Abstract
BACKGROUND Neurosurgeons are vulnerable to additional noise in their natural operating environment. Noise exposure is associated with reduced cognitive function, inability to concentrate, and nervousness. Mediation music provides an opportunity to create a calmer environment which may reduce stress during surgery. METHODS A pilot study was performed to find a suitable task, meditation music of surgeon's choice, and operation noise and to reach a certain level of training. For the main experiment, two neurosurgeons with different microsurgical experience used real operation noise and meditation music with delta waves as mediating music. Each surgeon performed 10 training bypasses (five with noise and five with music) with 16 stitches in each bypass. The total time to complete 16 stitches, a number of unachieved movements (N.U.Ms), length of thread consumed, and distribution of the stitches were quantified from the recorded videos and compared in both groups. RESULTS A N.U.Ms were significantly reduced from 109 ± 38 with operation room (OR) noise to 38 ± 13 (p < 0.05) with meditating music in novice surgeon. Similar results were found in the experienced surgeon performing the same task [from 29 ± 6.94 to 14 ± 3.36 (p < 0.05)]. The total time utilized for the sixteen stitches was slightly improved (not significantly) in the novice surgeon and unchanged in the experienced surgeon. However, the thread length used for 16 stitches was significantly different with OR noise in comparison to meditating music in both surgeons. The distribution stitches showed a non-significant trend toward a uniform distribution with meditation music in both surgeons. CONCLUSIONS Meditation music of surgeon's choice is a simple method that improved quality of bypass suturing in an experimental bypass procedure.
Collapse
|
39
|
Distinct neuronal entrainment to beat and meter: Revealed by simultaneous EEG-fMRI. Neuroimage 2019; 194:128-135. [DOI: 10.1016/j.neuroimage.2019.03.039] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2018] [Revised: 02/28/2019] [Accepted: 03/18/2019] [Indexed: 11/21/2022] Open
|
40
|
Gu L, Huang Y, Wu X. Advantage of audition over vision in a perceptual timing task but not in a sensorimotor timing task. PSYCHOLOGICAL RESEARCH 2019; 84:2046-2056. [PMID: 31190091 DOI: 10.1007/s00426-019-01204-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2019] [Accepted: 05/24/2019] [Indexed: 12/28/2022]
Abstract
Timing is essential for various behaviors and relative to vision, audition is considered to be specialized for temporal processing. The present study conducted a sensorimotor timing task that required tapping in synchrony with a temporally regular sequence and a perceptual timing task that required detecting a timing deviation among a temporally regular sequence. The sequence was composed of auditory tones, visual flashes, or a visual bouncing ball. In the sensorimotor task, sensorimotor timing performance (synchronization stability) of the bouncing ball was much greater than that of flashes and was comparable to that of tones. In the perceptual task, where perceptual timing performance of the bouncing ball was greater than that of flashes, it was poorer than that of tones. These results suggest the facilitation of both perceptual and sensorimotor processing of temporal information by the bouncing ball. Given such facilitation of temporal processing, however, audition is still superior over vision in perceptual detection of timing.
Collapse
Affiliation(s)
- Li Gu
- State Key Laboratory of Ophthalmology, Guangdong Provincial Key Lab of Ophthalmology and Visual Science, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangzhou, China.,Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Yingyu Huang
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China
| | - Xiang Wu
- Department of Psychology, Sun Yat-Sen University, 132 Waihuan East Road, Higher Education Mega Center, Guangzhou, 510006, Guangdong, China.
| |
Collapse
|
41
|
Abstract
Many animals can encode temporal intervals and use them to plan their actions, but only humans can flexibly extract a regular beat from complex patterns, such as musical rhythms. Beat-based timing is hypothesized to rely on the integration of sensory information with temporal information encoded in motor regions such as the medial premotor cortex (MPC), but how beat-based timing might be encoded in neuronal populations is mostly unknown. Gámez and colleagues show that the MPC encodes temporal information via a population code visible as circular trajectories in state space; these patterns may represent precursors to more-complex skills such as beat-based timing.
Collapse
Affiliation(s)
- Virginia B. Penhune
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
- Laboratory for Brain, Music and Sound Research–BRAMS, Montreal, Quebec, Canada
| | - Robert J. Zatorre
- Laboratory for Brain, Music and Sound Research–BRAMS, Montreal, Quebec, Canada
- Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
42
|
Ravignani A, Thompson B, Lumaca M, Grube M. Why Do Durations in Musical Rhythms Conform to Small Integer Ratios? Front Comput Neurosci 2018; 12:86. [PMID: 30555314 PMCID: PMC6282044 DOI: 10.3389/fncom.2018.00086] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 10/01/2018] [Indexed: 01/29/2023] Open
Abstract
One curious aspect of human timing is the organization of rhythmic patterns in small integer ratios. Behavioral and neural research has shown that adjacent time intervals in rhythms tend to be perceived and reproduced as approximate fractions of small numbers (e.g., 3/2). Recent work on iterated learning and reproduction further supports this: given a randomly timed drum pattern to reproduce, participants subconsciously transform it toward small integer ratios. The mechanisms accounting for this “attractor” phenomenon are little understood, but might be explained by combining two theoretical frameworks from psychophysics. The scalar expectancy theory describes time interval perception and reproduction in terms of Weber's law: just detectable durational differences equal a constant fraction of the reference duration. The notion of categorical perception emphasizes the tendency to perceive time intervals in categories, i.e., “short” vs. “long.” In this piece, we put forward the hypothesis that the integer-ratio bias in rhythm perception and production might arise from the interaction of the scalar property of timing with the categorical perception of time intervals, and that neurally it can plausibly be related to oscillatory activity. We support our integrative approach with mathematical derivations to formalize assumptions and provide testable predictions. We present equations to calculate durational ratios by: (i) parameterizing the relationship between durational categories, (ii) assuming a scalar timing constant, and (iii) specifying one (of K) category of ratios. Our derivations provide the basis for future computational, behavioral, and neurophysiological work to test our model.
Collapse
Affiliation(s)
- Andrea Ravignani
- Language and Cognition Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.,Artificial Intelligence Lab, Vrije Universiteit Brussel, Brussels, Belgium.,Research Department, Sealcentre Pieterburen, Pieterburen, Netherlands
| | - Bill Thompson
- Language and Cognition Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.,Artificial Intelligence Lab, Vrije Universiteit Brussel, Brussels, Belgium
| | - Massimo Lumaca
- Department of Clinical Medicine, Center for Music in the Brain, Aarhus University, Aarhus, Denmark
| | - Manon Grube
- Department of Clinical Medicine, Center for Music in the Brain, Aarhus University, Aarhus, Denmark
| |
Collapse
|
43
|
Kang H, Lancelin D, Pressnitzer D. Memory for Random Time Patterns in Audition, Touch, and Vision. Neuroscience 2018; 389:118-132. [PMID: 29577997 DOI: 10.1016/j.neuroscience.2018.03.017] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2017] [Revised: 03/09/2018] [Accepted: 03/13/2018] [Indexed: 11/28/2022]
Abstract
Perception deals with temporal sequences of events, like series of phonemes for audition, dynamic changes in pressure for touch textures, or moving objects for vision. Memory processes are thus needed to make sense of the temporal patterning of sensory information. Recently, we have shown that auditory temporal patterns could be learned rapidly and incidentally with repeated exposure [Kang et al., 2017]. Here, we tested whether rapid incidental learning of temporal patterns was specific to audition, or if it was a more general property of sensory systems. We used a same behavioral task in three modalities: audition, touch, and vision, for stimuli having identical temporal statistics. Participants were presented with sequences of acoustic pulses for audition, motion pulses to the fingertips for touch, or light pulses for vision. Pulses were randomly and irregularly spaced, with all inter-pulse intervals in the sub-second range and all constrained to be longer than the temporal acuity in any modality. This led to pulse sequences with an average inter-pulse interval of 166 ms, a minimum inter-pulse interval of 60 ms, and a total duration of 1.2 s. Results showed that, if a random temporal pattern re-occurred at random times during an experimental block, it was rapidly learned, whatever the sensory modality. Moreover, patterns first learned in the auditory modality displayed transfer of learning to either touch or vision. This suggests that sensory systems may be exquisitely tuned to incidentally learn re-occurring temporal patterns, with possible cross-talk between the senses.
Collapse
Affiliation(s)
- HiJee Kang
- Laboratoire des Systèmes Perceptifs, Département d'études cognitives, École Normale Supérieure, PSL Research University, CNRS, 29 rue d'Ulm, 75005 Paris, France.
| | - Denis Lancelin
- Laboratoire des Systèmes Perceptifs, Département d'études cognitives, École Normale Supérieure, PSL Research University, CNRS, 29 rue d'Ulm, 75005 Paris, France
| | - Daniel Pressnitzer
- Laboratoire des Systèmes Perceptifs, Département d'études cognitives, École Normale Supérieure, PSL Research University, CNRS, 29 rue d'Ulm, 75005 Paris, France.
| |
Collapse
|
44
|
Huang Y, Gu L, Yang J, Zhong S, Wu X. Relative Contributions of the Speed Characteristic and Other Possible Ecological Factors in Synchronization to a Visual Beat Consisting of Periodically Moving Stimuli. Front Psychol 2018; 9:1226. [PMID: 30072936 PMCID: PMC6058225 DOI: 10.3389/fpsyg.2018.01226] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2017] [Accepted: 06/27/2018] [Indexed: 11/13/2022] Open
Abstract
Daily music experience involves synchronizing movements in time with a perceived periodic beat. Contrary to the auditory-specific view of beat synchronization, synchronization to a visual beat composed of a periodically bouncing ball has been shown to be not less stable than synchronization to auditory beats. The ecological relevance of periodically moving visual stimuli is considered to be essential for such synchronization improvement. However, multiple factors could be associated with the ecological relevance and the relative contributions of the ecological factors to the synchronization improvement remain unclear. The present study investigated whether ecological factors other than a proposed critical factor, i.e., the speed characteristic, are required to account for the synchronization improvement of the bouncing ball. A periodically contracting ring that had the same speed characteristic as the periodically bouncing ball but lacked other possible ecological factors of the ball was designed. The results showed that synchronization was more stable for the bouncing ball than for the contracting ring, and this stability difference was larger in the difficult 300-ms than in the comfortable 600-ms inter-beat interval tapping condition. The finding suggests that ecological factors other than the speed characteristic are required to explain the synchronization improvement of periodically moving visual stimuli, particularly in difficult tapping conditions.
Collapse
Affiliation(s)
- Yingyu Huang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Li Gu
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Junkai Yang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Shengqi Zhong
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Xiang Wu
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| |
Collapse
|
45
|
Fattorini L, Rodio A. Acoustic and visual pacesetter influence on the energy expenditure in a cycling exercise. J Sports Med Phys Fitness 2018; 59:1126-1132. [PMID: 30024130 DOI: 10.23736/s0022-4707.18.08795-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
BACKGROUND The aim of this study was to evaluate the effects of acoustic and visual pacesetters on the energy expenditure in a steady state 30-minute long cycling. METHODS Eighteen healthy male subjects (age 27.6±4.59 years; height 1.78±0.07 m; body mass 80.1±7.85 kg) performed a 30-minute submaximal exercise at a constant workload on a cycle ergometer. The imposed workload required a metabolic expenditure corresponding to 70% of ventilatory threshold for each subject. Energy expenditure - expressed as a caloric equivalent relative to the total net oxygen consumption during exercise - was evaluated using three conditions: control (CT), no external pacesetter; acoustic (AT), listening to rhythmic acoustic stimuli at 120 beat per minute; and visual (VT), seeing footage consisting of eight different images in a looped sequence at 120 frames per minute. RESULTS All measured parameters qualified the exercise as requiring mainly an aerobic metabolism, showing no pain and no fatigue. AT and VT energy expenditure (5.0±0.44 and 4.9±0.39 MET respectively) were significantly lower compared to CT (5.5±0.49 MET), while no difference between AT and VT were recognized. CONCLUSIONS This study confirmed the ergogenic effect of the acoustic pacesetter on a 30-minute steady state rhythmic exercise. Novelty is that the visual pacesetter too was able to increase the mechanical efficiency as the same manner than the acoustic one. The present setting adopting visual pacesetter could be used in special categories, such as the deaf or in innovative technological tools as head-mounted display devices.
Collapse
Affiliation(s)
- Luigi Fattorini
- Department of Physiology and Pharmacology "V. Erspamer", Sapienza University, Rome, Italy -
| | - Angelo Rodio
- Department of Human Sciences, Society and Health, University of Cassino e Southern Lazio, Cassino, Frosinone, Italy
| |
Collapse
|
46
|
Yang J, Ouyang F, Holm L, Huang Y, Gan L, Zhou L, Chao H, Wang M, He M, Zhang S, Yang B, Pan J, Wu X. Tapping ahead of time: its association with timing variability. PSYCHOLOGICAL RESEARCH 2018; 84:343-351. [PMID: 29955958 DOI: 10.1007/s00426-018-1043-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2018] [Accepted: 06/21/2018] [Indexed: 11/28/2022]
Abstract
Researchers have puzzled over the phenomenon in sensorimotor timing that people tend to tap ahead of time. When synchronizing movements (e.g., finger taps) with an external sequence (e.g., a metronome), humans typically tap tens of milliseconds before event onsets, producing the elusive negative asynchrony. Here, we present 24 metronome-tapping data sets from 8 experiments with different experimental settings, showing that less negative asynchrony is associated with lower tapping variability. Further analyses reveal that this negative mean-SD correlation of asynchrony is likely to be observed for sequence types appropriate for synchronization, as indicated by the statistically negative lag 1 autocorrelation of inter-response intervals. The reported findings indicate an association between negative asynchrony and timing variability.
Collapse
Affiliation(s)
- Junkai Yang
- Laboratory for Behavioral and Regional Finance, Guangdong University of Finance, Guangzhou, China.,Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Feiyi Ouyang
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Linus Holm
- Department of Psychology, Umeå University, Umeå, 90187, Sweden.
| | - Yingyu Huang
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Lingyu Gan
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Liang Zhou
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Huizhen Chao
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Mengye Wang
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Mengxue He
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Sheng Zhang
- Department of Physiology, Anhui Medical College, Hefei, China
| | - Bo Yang
- Department of Neurology, First Affiliated Hospital of Anhui University of Traditional Chinese Medicine, Hefei, China
| | - Junhao Pan
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China
| | - Xiang Wu
- Department of Psychology, Sun Yat-Sen University, Higher Education Mega Center, 132 Waihuan East road, Guangzhou, 510006, Guangdong, China.
| |
Collapse
|
47
|
Modality-dependent effect of motion information in sensory-motor synchronised tapping. Neurosci Lett 2018; 675:31-35. [PMID: 29588176 DOI: 10.1016/j.neulet.2018.03.055] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2017] [Revised: 03/23/2018] [Accepted: 03/23/2018] [Indexed: 11/20/2022]
Abstract
Synchronised action is important for everyday life. Generally, the auditory domain is more sensitive for coding temporal information, and previous studies have shown that auditory-motor synchronisation is much more precise than visuo-motor synchronisation. Interestingly, adding motion information improves synchronisation with visual stimuli and the advantage of the auditory modality seems to diminish. However, whether adding motion information also improves auditory-motor synchronisation remains unknown. This study compared tapping accuracy with a stationary or moving stimulus in both auditory and visual modalities. Participants were instructed to tap in synchrony with the onset of a sound or flash in the stationary condition, while these stimuli were perceived as moving from side to side in the motion condition. The results demonstrated that synchronised tapping with a moving visual stimulus was significantly more accurate than tapping with a stationary visual stimulus, as previous studies have shown. However, tapping with a moving auditory stimulus was significantly poorer than tapping with a stationary auditory stimulus. Although motion information impaired audio-motor synchronisation, an advantage of auditory modality compared to visual modality still existed. These findings are likely the result of higher temporal resolution in the auditory domain, which is likely due to the physiological and structural differences in the auditory and visual pathways in the brain.
Collapse
|
48
|
Gámez J, Yc K, Ayala YA, Dotov D, Prado L, Merchant H. Predictive rhythmic tapping to isochronous and tempo changing metronomes in the nonhuman primate. Ann N Y Acad Sci 2018; 1423:396-414. [PMID: 29707785 DOI: 10.1111/nyas.13671] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2017] [Revised: 02/07/2018] [Accepted: 02/17/2018] [Indexed: 02/28/2024]
Abstract
Beat entrainment is the ability to entrain one's movements to a perceived periodic stimulus, such as a metronome or a pulse in music. Humans have a capacity to predictively respond to a periodic pulse and to dynamically adjust their movement timing to match the varying music tempos. Previous studies have shown that monkeys share some of the human capabilities for rhythmic entrainment, such as tapping regularly at the period of isochronous stimuli. However, it is still unknown whether monkeys can predictively entrain to dynamic tempo changes like humans. To address this question, we trained monkeys in three tapping tasks and compared their rhythmic entrainment abilities with those of humans. We found that, when immediate feedback about the timing of each movement is provided, monkeys can predictively entrain to an isochronous beat, generating tapping movements in anticipation of the metronome pulse. This ability also generalized to a novel untrained tempo. Notably, macaques can modify their tapping tempo by predicting the beat changes of accelerating and decelerating visual metronomes in a manner similar to humans. Our findings support the notion that nonhuman primates share with humans the ability of temporal anticipation during tapping to isochronous and smoothly changing sequences of stimuli.
Collapse
Affiliation(s)
- Jorge Gámez
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| | - Karyna Yc
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| | - Yaneri A Ayala
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| | - Dobromir Dotov
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| | - Luis Prado
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| | - Hugo Merchant
- Instituto de Neurobiología, UNAM, Campus Juriquilla, Querétaro, Mexico
| |
Collapse
|
49
|
|
50
|
Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis. Psychon Bull Rev 2017; 23:1882-1890. [PMID: 27246088 DOI: 10.3758/s13423-016-1067-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Humans show a striking advantage for synchronizing movements with discretely timed auditory metronomes (e.g., clicking sounds) over temporally matched visual metronomes (e.g., flashing lights), suggesting enhanced auditory-motor coupling for rhythmic processing. Does the auditory advantage persist for other modalities (not just vision)? Here, nonmusicians finger tapped to the beat of auditory, tactile, and bimodal metronomes. Stimulus magnitude and rhythmic complexity were also manipulated. In conditions involving a large area of stimulation and simple rhythmic sequences, tactile synchronization closely matched auditory. Although this finding shows a limitation to the hypothesis of enhanced auditory-motor coupling for rhythmic processing, other findings clearly support it. First, there was a robust advantage with auditory information for synchronization with complex rhythm sequences; moreover, in complex sequences a measure of error correction was found only when auditory information was present. Second, higher order grouping was evident only when auditory information was present.
Collapse
|