1
|
Czepiel AM, Fink LK, Scharinger M, Seibert C, Wald‐Fuhrmann M, Kotz SA. Audio-visual concert performances synchronize audience's heart rates. Ann N Y Acad Sci 2025; 1543:117-132. [PMID: 39752187 PMCID: PMC11776452 DOI: 10.1111/nyas.15279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
Abstract
People enjoy engaging with music. Live music concerts provide an excellent option to investigate real-world music experiences, and at the same time, use neurophysiological synchrony to assess dynamic engagement. In the current study, we assessed engagement in a live concert setting using synchrony of cardiorespiratory measures, comparing inter-subject, stimulus-response, correlation, and phase coherence. As engagement might be enhanced in a concert setting by seeing musicians perform, we presented audiences with audio-only (AO) and audio-visual (AV) piano performances. Only correlation synchrony measures were above chance level. In comparing time-averaged synchrony across conditions, AV performances evoked a higher inter-subject correlation of heart rate (ISC-HR). However, synchrony averaged across music pieces did not correspond to self-reported engagement. On the other hand, time-resolved analyses show that synchronized deceleration-acceleration heart rate (HR) patterns, typical of an "orienting response" (an index of directed attention), occurred within music pieces at salient events of section boundaries. That is, seeing musicians perform heightened audience engagement at structurally important moments in Western classical music. Overall, we could show that multisensory information shapes dynamic engagement. By comparing different synchrony measures, we further highlight the advantages of time series analysis, specifically ISC-HR, as a robust measure of holistic musical listening experiences in naturalistic concert settings.
Collapse
Affiliation(s)
- Anna M. Czepiel
- Department of PsychologyUniversity of Toronto MississaugaMississaugaOntarioCanada
- Department of MusicMax Planck Institute for Empirical AestheticsFrankfurt am MainGermany
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| | - Lauren K. Fink
- Department of MusicMax Planck Institute for Empirical AestheticsFrankfurt am MainGermany
- Department of Psychology, Neuroscience & BehaviourMcMaster UniversityHamiltonOntarioCanada
| | - Mathias Scharinger
- Research Group Phonetics, Department of German LinguisticsUniversity of MarburgMarburgGermany
- Department of Language and LiteratureMax Planck Institute for Empirical AestheticsFrankfurt am MainGermany
| | - Christoph Seibert
- Institute for Music Informatics and MusicologyUniversity of Music KarlsruheKarlsruheGermany
| | - Melanie Wald‐Fuhrmann
- Department of MusicMax Planck Institute for Empirical AestheticsFrankfurt am MainGermany
| | - Sonja A. Kotz
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
- Department of NeuropsychologyMax Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| |
Collapse
|
2
|
Abalde SF, Rigby A, Keller PE, Novembre G. A framework for joint music making: Behavioral findings, neural processes, and computational models. Neurosci Biobehav Rev 2024; 167:105816. [PMID: 39032841 DOI: 10.1016/j.neubiorev.2024.105816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 07/15/2024] [Accepted: 07/16/2024] [Indexed: 07/23/2024]
Abstract
Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.
Collapse
Affiliation(s)
- Sara F Abalde
- Neuroscience of Perception and Action Lab, Italian Institute of Technology, Rome, Italy; The Open University Affiliated Research Centre at the Istituto Italiano di Tecnologia, Italy.
| | - Alison Rigby
- Neurosciences Graduate Program, University of California, San Diego, USA
| | - Peter E Keller
- Center for Music in the Brain, Aarhus University, Denmark; Department of Clinical Medicine, Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Denmark; The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology, Rome, Italy
| |
Collapse
|
3
|
Tamburro G, Fiedler P, De Fano A, Raeisi K, Khazaei M, Vaquero L, Bruña R, Oppermann H, Bertollo M, Filho E, Zappasodi F, Comani S. An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action. Front Hum Neurosci 2023; 17:1305331. [PMID: 38125713 PMCID: PMC10730734 DOI: 10.3389/fnhum.2023.1305331] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 11/15/2023] [Indexed: 12/23/2023] Open
Abstract
A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.
Collapse
Affiliation(s)
- Gabriella Tamburro
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Antonio De Fano
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Khadijeh Raeisi
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Mohammad Khazaei
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Lucia Vaquero
- Center for Cognitive and Computational Neuroscience, Universidad Complutense de Madrid, Madrid, Spain
- Department of Experimental Pschology, Cognitive Processes and Speech Therapy, Universidad Complutense de Madrid, Madrid, Spain
| | - Ricardo Bruña
- Center for Cognitive and Computational Neuroscience, Universidad Complutense de Madrid, Madrid, Spain
- Department of Radiology, Universidad Complutense de Madrid, IdISSC, Madrid, Spain
| | - Hannes Oppermann
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Maurizio Bertollo
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Department of Medicine and Sciences of Aging, “University G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Edson Filho
- Wheelock College of Education and Human Development, Boston University, Boston, MA, United States
| | - Filippo Zappasodi
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Silvia Comani
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| |
Collapse
|
4
|
Gibbs HJ, Czepiel A, Egermann H. Physiological synchrony and shared flow state in Javanese gamelan: positively associated while improvising, but not for traditional performance. Front Psychol 2023; 14:1214505. [PMID: 37663327 PMCID: PMC10469686 DOI: 10.3389/fpsyg.2023.1214505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 08/02/2023] [Indexed: 09/05/2023] Open
Abstract
The experience of shared flow refers to the optimal balance between challenge and ability for a given task, resulting from interpersonal action in a group situation. The performance of Javanese gamelan is an ideal setting to investigate shared flow, due to the requirement that all performers on varying instrumental parts work harmoniously, allowing for shared flow and its native equivalent, ngeli. To minimise the disruption of flow, while still measuring it continuously, one way to assess a person's state is by measuring physiological responses of the sympathetic (i.e., fight-or-flight) system, namely heart rate and skin conductance. Flow has been related to physiological signatures, and shared actions in music-making have been related to synchronised physiology. However, to our knowledge, no study yet has directly investigated the links between shared physiology and shared flow. Therefore, this study aimed to assess the associations between flow states, physiological synchrony, and Javanese gamelan playing. Subsequently, we tested for differences between advanced and beginner groups playing traditional gamelan pieces and improvising. Firstly, a factor analysis revealed a two-factor solution of Awareness and Absorption for self-reported shared flow. Next, using inter-subject correlation to assess synchrony and circular shuffling to infer significance, we found a greater proportion of significance in traditional playing compared to improvised playing for the experienced group, and the opposite for the beginner group. Lastly, linear mixed models revealed largely positive associations between synchronised physiology and shared flow during improvised playing, and negative associations during traditional playing, regardless of experience levels. This study demonstrates methodological possibilities for the quantitative study of shared flow in music-making contexts, and potential differences in shared flow experience in improvised and traditional, or prescribed, playing.
Collapse
Affiliation(s)
- Hannah Jennet Gibbs
- York Music Psychology Group, Music, Science and Technology Research Cluster, School of Arts and Creative Technologies, University of York, York, United Kingdom
| | - Anna Czepiel
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Hauke Egermann
- Institute for Music and Musicology, TU Dortmund University, Dortmund, Germany
| |
Collapse
|
5
|
Delius JAM, Müller V. Interpersonal synchrony when singing in a choir. Front Psychol 2023; 13:1087517. [PMID: 36710769 PMCID: PMC9875726 DOI: 10.3389/fpsyg.2022.1087517] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 12/21/2022] [Indexed: 01/13/2023] Open
Abstract
Singing in a choir has long been known to enhance well-being and protect mental health. Clearly, the experience of a uniquely harmonious social activity is very satisfying for the singers. How might this come about? One of the important factors positively associated with well-being is interpersonal action coordination allowing the choir to function as a whole. This review focuses on temporal coordination dynamics of physiological systems and/or subsystems forming part or the core of the functional substrate of choir singing. These coordination dynamics will be evaluated with respect to the concept of a superordinate system, or superorganism, based on the principles of self-organization and circular causality. We conclude that choral singing is a dynamic process requiring tight interpersonal action coordination that is characterized by coupled physiological systems and specific network topology dynamics, representing a potent biomarker for social interaction.
Collapse
|