Extracting human cortical responses to sound onsets and acoustic feature changes in real music, and their relation to event rate

Musical and electrical stimulation as intervention in disorder of consciousness (DOC) patients: A randomised cross-over trial

BACKGROUND

Disorders of consciousness (DOC), i.e., unresponsive wakefulness syndrome (UWS) or vegetative state (VS) and minimally conscious state (MCS), are conditions that can arise from severe brain injury, inducing widespread functional changes. Given the damaging implications resulting from these conditions, there is an increasing need for rehabilitation treatments aimed at enhancing the level of consciousness, the quality of life, and creating new recovery perspectives for the patients. Music may represent an additional rehabilitative tool in contexts where cognition and language are severely compromised, such as among DOC patients. A further type of rehabilitation strategies for DOC patients consists of Non-Invasive Brain Stimulation techniques (NIBS), including transcranial electrical stimulation (tES), affecting neural excitability and promoting brain plasticity.

OBJECTIVE

We here propose a novel rehabilitation protocol for DOC patients that combines music-based intervention and NIBS in neurological patients. The main objectives are (i) to assess the residual neuroplastic processes in DOC patients exposed to music, (ii) to determine the putative neural modulation and the clinical outcome in DOC patients of non-pharmacological strategies, i.e., tES(control condition), and music stimulation, and (iii) to evaluate the putative positive impact of this intervention on caregiver's burden and psychological distress.

METHODS

This is a randomised cross-over trial in which a total of 30 participants will be randomly allocated to one of three different combinations of conditions: (i) Music only, (ii) tES only (control condition), (iii) Music + tES. The music intervention will consist of listening to an individually tailored playlist including familiar and self-relevant music together with fixed songs; concerning NIBS, tES will be applied for 20 minutes every day, 5 times a week, for two weeks. After these stimulations two weeks of placebo treatments will follow, with sham stimulation combined with noise for other two weeks. The primary outcomes will be clinical, i.e., based on the differences in the scores obtained on the neuropsychological tests, such as Coma Recovery Scale-Revised, and neurophysiological measures as EEG, collected pre-intervention, post-intervention and post-placebo.

DISCUSSION

This study proposes a novel rehabilitation protocol for patients with DOC including a combined intervention of music and NIBS. Considering the need for rigorous longitudinal randomised controlled trials for people with severe brain injury disease, the results of this study will be highly informative for highlighting and implementing the putative beneficial role of music and NIBS in rehabilitation treatments.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT05706831, registered on January 30, 2023.

Syncopation as Probabilistic Expectation: Conceptual, Computational, and Experimental Evidence

Definitions of syncopation share two characteristics: the presence of a meter or analogous hierarchical rhythmic structure and a displacement or contradiction of that structure. These attributes are translated in terms of a Bayesian theory of syncopation, where the syncopation of a rhythm is inferred based on a hierarchical structure that is, in turn, learned from the ongoing musical stimulus. Several experiments tested its simplest possible implementation, with equally weighted priors associated with different meters and independence of auditory events, which can be decomposed into two terms representing note density and deviation from a metric hierarchy. A computational simulation demonstrated that extant measures of syncopation fall into two distinct factors analogous to the terms in the simple Bayesian model. Next, a series of behavioral experiments found that perceived syncopation is significantly related to both terms, offering support for the general Bayesian construction of syncopation. However, we also found that the prior expectations associated with different metric structures are not equal across meters and that there is an interaction between density and hierarchical deviation, implying that auditory events are not independent from each other. Together, these findings provide evidence that syncopation is a manifestation of a form of temporal expectation that can be directly represented in Bayesian terms and offer a complementary, feature-driven approach to recent Bayesian models of temporal prediction.

Moderate associations between BDNF Val66Met gene polymorphism, musical expertise, and mismatch negativity

Auditory predictive processing relies on a complex interaction between environmental, neurophysiological, and genetic factors. In this view, the mismatch negativity (MMN) and intensive training on a musical instrument for several years have been used for studying environment-driven neural adaptations in audition. In addition, brain-derived neurotrophic factor (BDNF) has been shown crucial for both the neurogenesis and the later adaptation of the auditory system. The functional single-nucleotide polymorphism (SNP) Val66Met (rs6265) in the BDNF gene can affect BDNF protein levels, which are involved in neurobiological and neurophysiological processes such as neurogenesis and neuronal plasticity. In this study, we hypothesised that genetic variation within the BDNF gene would be associated with different levels of neuroplasticity of the auditory cortex in 74 musically trained participants. To achieve this goal, musicians and non-musicians were recruited and divided in Val/Val and Met- (Val/Met and Met/Met) carriers and their brain activity was measured with magnetoencephalography (MEG) while they listened to a regular auditory sequence eliciting different types of prediction errors. MMN responses indexing those prediction errors were overall enhanced in Val/Val carriers who underwent intensive musical training, compared to Met-carriers and non-musicians with either genotype. Although this study calls for replications with larger samples, our results provide a first glimpse of the possible role of gene-regulated neurotrophic factors in the neural adaptations of automatic predictive processing in the auditory domain after long-term training.

Age differences in central auditory system responses to naturalistic music

Aging influences the central auditory system leading to difficulties in the decoding and understanding of overlapping sound signals, such as speech in noise or polyphonic music. Studies on central auditory system evoked responses (ERs) have found in older compared to young listeners increased amplitudes (less inhibition) of the P1 and N1 and decreased amplitudes of the P2, mismatch negativity (MMN), and P3a responses. While preceding research has focused on simplified auditory stimuli, we here tested whether the previously observed age-related differences could be replicated with sounds embedded in medium and highly naturalistic musical contexts. Older (age 55-77 years) and younger adults (age 21-31 years) listened to medium naturalistic (synthesized melody) and highly naturalistic (studio recording of a music piece) stimuli. For the medium naturalistic music, the age group differences on the P1, N1, P2, MMN, and P3a amplitudes were all replicated. The age group differences, however, appeared reduced with the highly compared to the medium naturalistic music. The finding of lower P2 amplitude in older than young was replicated for slow event rates (0.3-2.9Hz) in the highly naturalistic music. Moreover, the ER latencies suggested a gradual slowing of the auditory processing time course for highly compared to medium naturalistic stimuli irrespective of age. These results support that age-related differences on ERs can partly be observed with naturalistic stimuli. This opens new avenues for including naturalistic stimuli in the investigation of age-related central auditory system disorders.

The neuroscience of music – towards ecological validity

Studies in the neuroscience of music gained momentum in the 1990s as an integrated part of the well-controlled experimental research tradition. However, during the past two decades, these studies have moved toward more naturalistic, ecologically valid paradigms. Here, I introduce this move in three frameworks: (i) sound stimulation and empirical paradigms, (ii) study participants, and (iii) methods and contexts of data acquisition. I wish to provide a narrative historical overview of the development of the field and, in parallel, to stimulate innovative thinking to further advance the ecological validity of the studies without overlooking experimental rigor.

Mismatch negativity-stimulation paradigms in past and in future

Mismatch negativity (MMN) studies were initiated as part of a well-controlled experimental research tradition with the aim to identify some key principles of auditory processing and memory. During the past two decades, empirical paradigms have moved toward more ecologically valid ones while retaining rigid experimental control. In this paper, I will introduce this development of MMN stimulation paradigms starting from the paradigms used in basic science and then moving to paradigms that have been particularly relevant for studies on music learning and musical expertise. Via these historical and thematic perspectives, I wish to stimulate paradigm development further to meet the demands of naturalistic ecologically valid studies also when using MMN in the context of event-related potential technique that necessarily requires averaging across several stimulus presentations.

On the encoding of natural music in computational models and human brains

This article discusses recent developments and advances in the neuroscience of music to understand the nature of musical emotion. In particular, it highlights how system identification techniques and computational models of music have advanced our understanding of how the human brain processes the textures and structures of music and how the processed information evokes emotions. Musical models relate physical properties of stimuli to internal representations called features, and predictive models relate features to neural or behavioral responses and test their predictions against independent unseen data. The new frameworks do not require orthogonalized stimuli in controlled experiments to establish reproducible knowledge, which has opened up a new wave of naturalistic neuroscience. The current review focuses on how this trend has transformed the domain of the neuroscience of music.

Atonal Music as a Model for Investigating Exploratory Behavior

Atonal music is often characterized by low predictability stemming from the absence of tonal or metrical hierarchies. In contrast, Western tonal music exhibits intrinsic predictability due to its hierarchical structure and therefore, offers a directly accessible predictive model to the listener. In consequence, a specific challenge of atonal music is that listeners must generate a variety of new predictive models. Listeners must not only refrain from applying available tonal models to the heard music, but they must also search for statistical regularities and build new rules that may be related to musical properties other than pitch, such as timbre or dynamics. In this article, we propose that the generation of such new predictive models and the aesthetic experience of atonal music are characterized by internal states related to exploration. This is a behavior well characterized in behavioral neuroscience as fulfilling an innate drive to reduce uncertainty but which has received little attention in empirical music research. We support our proposal with emerging evidence that the hedonic value is associated with the recognition of patterns in low-predictability sound sequences and that atonal music elicits distinct behavioral responses in listeners. We end by outlining new research avenues that might both deepen our understanding of the aesthetic experience of atonal music in particular, and reveal core qualities of the aesthetic experience in general.

Real-Time Audio Processing of Real-Life Soundscapes for EEG Analysis: ERPs Based on Natural Sound Onsets

With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS), and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed a stable lag and a small jitter (< 3 ms) indicating a high temporal precision of the system. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.

Prediction under uncertainty: Dissociating sensory from cognitive expectations in highly uncertain musical contexts

Predictive models in the brain rely on the continuous extraction of regularities from the environment. These models are thought to be updated by novel information, as reflected in prediction error responses such as the mismatch negativity (MMN). However, although in real life individuals often face situations in which uncertainty prevails, it remains unclear whether and how predictive models emerge in high-uncertainty contexts. Recent research suggests that uncertainty affects the magnitude of MMN responses in the context of music listening. However, musical predictions are typically studied with MMN stimulation paradigms based on Western tonal music, which are characterized by relatively high predictability. Hence, we developed an MMN paradigm to investigate how the high uncertainty of atonal music modulates predictive processes as indexed by the MMN and behavior. Using MEG in a group of 20 subjects without musical training, we demonstrate that the magnetic MMN in response to pitch, intensity, timbre, and location deviants is evoked in both tonal and atonal melodies, with no significant differences between conditions. In contrast, in a separate behavioral experiment involving 39 non-musicians, participants detected pitch deviants more accurately and rated confidence higher in the tonal than in the atonal musical context. These results indicate that contextual tonal uncertainty modulates processing stages in which conscious awareness is involved, although deviants robustly elicit low-level pre-attentive responses such as the MMN. The achievement of robust MMN responses, despite high tonal uncertainty, is relevant for future studies comparing groups of listeners' MMN responses to increasingly ecological music stimuli.

Neural Correlates of Music Listening: Does the Music Matter?

The last decades have seen a proliferation of music and brain studies, with a major focus on plastic changes as the outcome of continuous and prolonged engagement with music. Thanks to the advent of neuroaesthetics, research on music cognition has broadened its scope by considering the multifarious phenomenon of listening in all its forms, including incidental listening up to the skillful attentive listening of experts, and all its possible effects. These latter range from objective and sensorial effects directly linked to the acoustic features of the music to the subjectively affective and even transformational effects for the listener. Of special importance is the finding that neural activity in the reward circuit of the brain is a key component of a conscious listening experience. We propose that the connection between music and the reward system makes music listening a gate towards not only hedonia but also eudaimonia, namely a life well lived, full of meaning that aims at realizing one's own "daimon" or true nature. It is argued, further, that music listening, even when conceptualized in this aesthetic and eudaimonic framework, remains a learnable skill that changes the way brain structures respond to sounds and how they interact with each other.

Brain predictive coding processes are associated to COMT gene Val158Met polymorphism

Predicting events in the ever-changing environment is a fundamental survival function intrinsic to the physiology of sensory systems, whose efficiency varies among the population. Even though it is established that a major source of such variations is genetic heritage, there are no studies tracking down auditory predicting processes to genetic mutations. Thus, we examined the neurophysiological responses to deviant stimuli recorded with magnetoencephalography (MEG) in 108 healthy participants carrying different variants of Val158Met single-nucleotide polymorphism (SNP) within the catechol-O-methyltransferase (COMT) gene, responsible for the majority of catecholamines degradation in the prefrontal cortex. Our results showed significant amplitude enhancement of prediction error responses originating from the inferior frontal gyrus, superior and middle temporal cortices in heterozygous genotype carriers (Val/Met) vs homozygous (Val/Val and Met/Met) carriers. Integrating neurophysiology and genetics, this study shows how the neural mechanisms underlying optimal deviant detection vary according to the gene-determined cathecolamine levels in the brain.