1
|
Michałko A, Di Stefano N, Campo A, Leman M. Enhancing human-human musical interaction through kinesthetic haptic feedback using wearable exoskeletons: theoretical foundations, validation scenarios, and limitations. Front Psychol 2024; 15:1327992. [PMID: 38515976 PMCID: PMC10954903 DOI: 10.3389/fpsyg.2024.1327992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 02/23/2024] [Indexed: 03/23/2024] Open
Abstract
In this perspective paper, we explore the use of haptic feedback to enhance human-human interaction during musical tasks. We start by providing an overview of the theoretical foundation that underpins our approach, which is rooted in the embodied music cognition framework, and by briefly presenting the concepts of action-perception loop, sensorimotor coupling and entrainment. Thereafter, we focus on the role of haptic information in music playing and we discuss the use of wearable technologies, namely lightweight exoskeletons, for the exchange of haptic information between humans. We present two experimental scenarios in which the effectiveness of this technology for enhancing musical interaction and learning might be validated. Finally, we briefly discuss some of the theoretical and pedagogical implications of the use of technologies for haptic communication in musical contexts, while also addressing the potential barriers to the widespread adoption of exoskeletons in such contexts.
Collapse
Affiliation(s)
- Aleksandra Michałko
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium
| | - Nicola Di Stefano
- Institute of Cognitive Sciences and Technologies, National Research Council of Italy (CNR), Rome, Italy
| | - Adriaan Campo
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium
| | - Marc Leman
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium
| |
Collapse
|
2
|
de Lafuente V, Jazayeri M, Merchant H, García-Garibay O, Cadena-Valencia J, Malagón AM. Keeping time and rhythm by internal simulation of sensory stimuli and behavioral actions. SCIENCE ADVANCES 2024; 10:eadh8185. [PMID: 38198556 PMCID: PMC10780886 DOI: 10.1126/sciadv.adh8185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 12/11/2023] [Indexed: 01/12/2024]
Abstract
Effective behavior often requires synchronizing our actions with changes in the environment. Rhythmic changes in the environment are easy to predict, and we can readily time our actions to them. Yet, how the brain encodes and maintains rhythms is not known. Here, we trained primates to internally maintain rhythms of different tempos and performed large-scale recordings of neuronal activity across the sensory-motor hierarchy. Results show that maintaining rhythms engages multiple brain areas, including visual, parietal, premotor, prefrontal, and hippocampal regions. Each recorded area displayed oscillations in firing rates and oscillations in broadband local field potential power that reflected the temporal and spatial characteristics of an internal metronome, which flexibly encoded fast, medium, and slow tempos. The presence of widespread metronome-related activity, in the absence of stimuli and motor activity, suggests that internal simulation of stimuli and actions underlies timekeeping and rhythm maintenance.
Collapse
Affiliation(s)
- Victor de Lafuente
- Institute of Neurobiology, National Autonomous University of Mexico, Boulevard Juriquilla 3001, Querétaro, QRO 76230, México
| | - Mehrdad Jazayeri
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Hugo Merchant
- Institute of Neurobiology, National Autonomous University of Mexico, Boulevard Juriquilla 3001, Querétaro, QRO 76230, México
| | - Otto García-Garibay
- Institute of Neurobiology, National Autonomous University of Mexico, Boulevard Juriquilla 3001, Querétaro, QRO 76230, México
| | - Jaime Cadena-Valencia
- Institute of Neurobiology, National Autonomous University of Mexico, Boulevard Juriquilla 3001, Querétaro, QRO 76230, México
- Faculty of Science and Medicine, Department of Neurosciences and Movement Sciences, University of Fribourg, Fribourg 1700, Switzerland
- Cognitive Neuroscience Laboratory, German Primate Center—Leibniz Institute for Primate Research, Göttingen 37077, Germany
| | - Ana M. Malagón
- Institute of Neurobiology, National Autonomous University of Mexico, Boulevard Juriquilla 3001, Querétaro, QRO 76230, México
| |
Collapse
|
3
|
Vanbilsen N, Kotz SA, Rosso M, Leman M, Triccas LT, Feys P, Moumdjian L. Auditory attention measured by EEG in neurological populations: systematic review of literature and meta-analysis. Sci Rep 2023; 13:21064. [PMID: 38030693 PMCID: PMC10687139 DOI: 10.1038/s41598-023-47597-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 11/16/2023] [Indexed: 12/01/2023] Open
Abstract
Sensorimotor synchronization strategies have been frequently used for gait rehabilitation in different neurological populations. Despite these positive effects on gait, attentional processes required to dynamically attend to the auditory stimuli needs elaboration. Here, we investigate auditory attention in neurological populations compared to healthy controls quantified by EEG recordings. Literature was systematically searched in databases PubMed and Web of Science. Inclusion criteria were investigation of auditory attention quantified by EEG recordings in neurological populations in cross-sectional studies. In total, 35 studies were included, including participants with Parkinson's disease (PD), stroke, Traumatic Brain Injury (TBI), Multiple Sclerosis (MS), Amyotrophic Lateral Sclerosis (ALS). A meta-analysis was performed on P3 amplitude and latency separately to look at the differences between neurological populations and healthy controls in terms of P3 amplitude and latency. Overall, neurological populations showed impairments in auditory processing in terms of magnitude and delay compared to healthy controls. Consideration of individual auditory processes and thereafter selecting and/or designing the auditory structure during sensorimotor synchronization paradigms in neurological physical rehabilitation is recommended.
Collapse
Affiliation(s)
- Nele Vanbilsen
- Universitair Multiple Sclerosis Centrum (UMSC), Hasselt-Pelt, Hasselt, Belgium.
- Faculty of Rehabilitation Sciences, REVAL Rehabilitation Research Center, University of Hasselt, Agoralaan Gebouw A, 3590, Diepenbeek, Belgium.
| | - Sonja A Kotz
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Mattia Rosso
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, University of Ghent, Miriam Makebaplein 1, 9000, Gent, Belgium
- Université de Lille, ULR 4072 - PSITEC - Psychologie: Interactions, Temps, Emotions, Cognition, Lille, France
| | - Marc Leman
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, University of Ghent, Miriam Makebaplein 1, 9000, Gent, Belgium
| | - Lisa Tedesco Triccas
- Faculty of Rehabilitation Sciences, REVAL Rehabilitation Research Center, University of Hasselt, Agoralaan Gebouw A, 3590, Diepenbeek, Belgium
- Department of Movement and Clinical Neurosciences, Institute of Neurology, University College London, 33 Queen Square, London, UK
| | - Peter Feys
- Universitair Multiple Sclerosis Centrum (UMSC), Hasselt-Pelt, Hasselt, Belgium
- Faculty of Rehabilitation Sciences, REVAL Rehabilitation Research Center, University of Hasselt, Agoralaan Gebouw A, 3590, Diepenbeek, Belgium
| | - Lousin Moumdjian
- Universitair Multiple Sclerosis Centrum (UMSC), Hasselt-Pelt, Hasselt, Belgium
- Faculty of Rehabilitation Sciences, REVAL Rehabilitation Research Center, University of Hasselt, Agoralaan Gebouw A, 3590, Diepenbeek, Belgium
- Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, University of Ghent, Miriam Makebaplein 1, 9000, Gent, Belgium
| |
Collapse
|
4
|
Rosso M, van Kerrebroeck B, Maes PJ, Leman M. Embodied perspective-taking enhances interpersonal synchronization: A body-swap study. iScience 2023; 26:108099. [PMID: 37920667 PMCID: PMC10618832 DOI: 10.1016/j.isci.2023.108099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/20/2023] [Accepted: 09/27/2023] [Indexed: 11/04/2023] Open
Abstract
Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.
Collapse
Affiliation(s)
- Mattia Rosso
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
- PSITEC - Psychologie: Interactions, Temps, Emotions, Cognition - ULR 4072, University of Lille, 59650 Lille, Hauts-de-France, France
| | - Bavo van Kerrebroeck
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
- SPL - Sequence Production Lab, McGill University, Montreal, Quebec H3A 1B1, Canada
- IDMIL – Input Devices. And Music Interaction Laboratory, McGill University, Montréal, Québec H3A 1E3, Canada
| | - Pieter-Jan Maes
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
| | - Marc Leman
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
| |
Collapse
|