The Encephalophone: A Novel Musical Biofeedback Device using Conscious Control of Electroencephalogram (EEG)

Music in the loop: a systematic review of current neurofeedback methodologies using music

Music, a universal element in human societies, possesses a profound ability to evoke emotions and influence mood. This systematic review explores the utilization of music to allow self-control of brain activity and its implications in clinical neuroscience. Focusing on music-based neurofeedback studies, it explores methodological aspects and findings to propose future directions. Three key questions are addressed: the rationale behind using music as a stimulus, its integration into the feedback loop, and the outcomes of such interventions. While studies emphasize the emotional link between music and brain activity, mechanistic explanations are lacking. Additionally, there is no consensus on the imaging or behavioral measures of neurofeedback success. The review suggests considering whole-brain neural correlates of music stimuli and their interaction with target brain networks and reward mechanisms when designing music-neurofeedback studies. Ultimately, this review aims to serve as a valuable resource for researchers, facilitating a deeper understanding of music's role in neurofeedback and guiding future investigations.

Public Perception of the Brain-Computer Interface: Insights from a Decade of Data on X

BACKGROUND

Given the recent evolution and achievements in Brain-Computer interface (BCI) technologies, understanding public perception and sentiments towards such novel technologies is important for guiding their communication strategies in marketing and education.

OBJECTIVE

This study aims to explore the public perception of BCI technology by examining posts on X (Twitter), utilizing Natural Language Processing (NLP) methods.

METHODS

A mixed-methods study was conducted on BCI-related posts from January 2010 to December 2021. The dataset included 65,340 posts from 38,926 unique users. This dataset was subject to a detailed NLP analysis including VADER, TextBlob, and NRCLex libraries, focusing on quantifying the sentiment (positive, neutral, and negative), the degree of subjectivity, and the range of emotions expressed in the posts. The temporal dynamics of sentiments were examined using the Mann-Kendall trend test to identify significant trends or shifts in public interest over time, based on monthly incidence. We utilized the Sentiment.ai tool to infer users' demographics by matching pre-defined attributes in users' profile biographies to certain demographic groups. We used the BERTopic tool for semantic understanding of discussions related to BCI.

RESULTS

The analysis showed a significant rise in BCI discussions in 2017, coinciding with Elon Musk's announcement of Neuralink. Sentiment analysis revealed that 59.38% of posts were neutral, 32.75% were positive, and 7.85% were negative. The average polarity score demonstrated a generally positive trend over the course of the study (Mann-Kendall Statistic = 0.266, tau = 0.266, P<.001). Most posts were objective (77.81%), with a smaller proportion being subjective (22.02%). Biographic analysis showed that the 'Broadcasting' group contributed the most to BCI discussions (30.67%), but the 'Scientific' group, which contributed 27.58% of the discussions, had the highest overall engagement metrics. Emotional analysis identified anticipation (20.56%), trust (17.59%), and fear (13.98%) as the most prominent emotions in BCI discussions. Key topics included Neuralink and Elon Musk, practical applications of BCIs, and the potential for gamification.

CONCLUSIONS

This NLP-assisted study provides a decade-long analysis of public perception of BCI technology based on data from X. Overall, sentiments were neutral yet cautiously apprehensive, with anticipation, trust, and fear as the dominant emotions. The presence of fear underscores the need to address ethical concerns, particularly around data privacy, safety, and transparency. Transparent communication and ethical considerations are essential for building public trust and reducing apprehension. Influential figures and positive clinical outcomes, such as advancements in neuroprosthetics, could enhance favorable perceptions. The gamification of BCI, particularly in gaming and entertainment, also offers potential for wider public engagement and adoption. However, public perceptions on X may differ from other platforms, affecting the broader interpretation of results. Despite these limitations, the findings provide valuable insights for guiding future BCI developments, policy-making, and communication strategies.

CLINICALTRIAL

Musical Neurofeedback Advancements, Feedback Modalities, and Applications: A Systematic Review

The field of EEG-Neurofeedback (EEG-NF) training has showcased significant promise in treating various mental disorders, while also emerging as a cognitive enhancer across diverse applications. The core principle of EEG-NF involves consciously guiding the brain in desired directions, necessitating active engagement in neurofeedback (NF) tasks over an extended period. Music listening tasks have proven to be effective stimuli for such training, influencing emotions, mood, and brainwave patterns. This has spurred the development of musical NF systems and training protocols. Despite these advancements, there exists a gap in systematic literature that comprehensively explores and discusses the various modalities of feedback mechanisms, its benefits, and the emerging applications. Addressing this gap, our review article presents a thorough literature survey encompassing studies on musical NF conducted over the past decade. This review highlights the several benefits and applications ranging from neurorehabilitation to therapeutic interventions, stress management, diagnostics of neurological disorders, and sports performance enhancement. While acknowledged for advantages and popularity of musical NF, there is an opportunity for growth in the literature in terms of the need for systematic randomized controlled trials to compare its effectiveness with other modalities across different tasks. Addressing this gap will involve developing standardized methodologies for studying protocols and optimizing parameters, presenting an exciting prospect for advancing the field.

Exploring Brain Dynamics via EEG and Steady-State Activation Map Networks in Music Composition

In recent years, the integration of brain-computer interface technology and neural networks in the field of music generation has garnered widespread attention. These studies aimed to extract individual-specific emotional and state information from electroencephalogram (EEG) signals to generate unique musical compositions. While existing research has focused primarily on brain regions associated with emotions, this study extends this research to brain regions related to musical composition. To this end, a novel neural network model incorporating attention mechanisms and steady-state activation mapping (SSAM) was proposed. In this model, the self-attention module enhances task-related information in the current state matrix, while the extended attention module captures the importance of state matrices over different time frames. Additionally, a convolutional neural network layer is used to capture spatial information. Finally, the ECA module integrates the frequency information learned by the model in each of the four frequency bands, mapping these by learning their complementary frequency information into the final attention representation. Evaluations conducted on a dataset specifically constructed for this study revealed that the model surpassed representative models in the emotion recognition field, with recognition rate improvements of 1.47% and 3.83% for two different music states. Analysis of the attention matrix indicates that the left frontal lobe and occipital lobe are the most critical brain regions in distinguishing between 'recall and creation' states, while FP1, FPZ, O1, OZ, and O2 are the electrodes most related to this state. In our study of the correlations and significances between these areas and other electrodes, we found that individuals with musical training exhibit more extensive functional connectivity across multiple brain regions. This discovery not only deepens our understanding of how musical training can enhance the brain's ability to work in coordination but also provides crucial guidance for the advancement of brain-computer music generation technologies, particularly in the selection of key brain areas and electrode configurations. We hope our research can guide the work of EEG-based music generation to create better and more personalized music.

[Applications and challenges of wearable electroencephalogram signals in depression recognition and personalized music intervention]

Rapid and accurate identification and effective non-drug intervention are the worldwide challenges in the field of depression. Electroencephalogram (EEG) signals contain rich quantitative markers of depression, but whole-brain EEG signals acquisition process is too complicated to be applied on a large-scale population. Based on the wearable frontal lobe EEG monitoring device developed by the authors' laboratory, this study discussed the application of wearable EEG signal in depression recognition and intervention. The technical principle of wearable EEG signals monitoring device and the commonly used wearable EEG devices were introduced. Key technologies for wearable EEG signals-based depression recognition and the existing technical limitations were reviewed and discussed. Finally, a closed-loop brain-computer music interface system for personalized depression intervention was proposed, and the technical challenges were further discussed. This review paper may contribute to the transformation of relevant theories and technologies from basic research to application, and further advance the process of depression screening and personalized intervention.

Human Body Rhythms in the Development of Non-Invasive Methods of Closed-Loop Adaptive Neurostimulation

The creation and improvement of non-invasive closed-loop brain stimulation technologies represent an exciting and rapidly expanding field of neuroscience. To identify the appropriate way to close the feedback loop in adaptive neurostimulation procedures, it was previously proposed to use on-line automatic sensory stimulation with the parameters modulated by the patient's own rhythmical processes, such as respiratory rate, heart rate, and electroencephalogram (EEG) rhythms. The current paper aims to analyze several recent studies demonstrating further development in this line of research. The advantages of using automatic closed-loop feedback from human endogenous rhythms in non-invasive adaptive neurostimulation procedures have been demonstrated for relaxation assistance, for the correction of stress-induced functional disturbances, for anxiety management, and for the cognitive rehabilitation of an individual. Several distinctive features of the approach are noted to delineate its further development.

Self-health monitoring and wearable neurotechnologies

Brain-computer interfaces and wearable neurotechnologies are now used to measure real-time neural and physiologic signals from the human body and hold immense potential for advancements in medical diagnostics, prevention, and intervention. Given the future role that wearable neurotechnologies will likely serve in the health sector, a critical state-of-the-art assessment is necessary to gain a better understanding of their current strengths and limitations. In this chapter we present wearable electroencephalography systems that reflect groundbreaking innovations and improvements in real-time data collection and health monitoring. We focus on specifications reflecting technical advantages and disadvantages, discuss their use in fundamental and clinical research, their current applications, limitations, and future directions. While many methodological and ethical challenges remain, these systems host the potential to facilitate large-scale data collection far beyond the reach of traditional research laboratory settings.

A closed-loop, music-based brain-computer interface for emotion mediation

Emotions play a critical role in rational and intelligent behavior; a better fundamental knowledge of them is indispensable for understanding higher order brain function. We propose a non-invasive brain-computer interface (BCI) system to feedback a person’s affective state such that a closed-loop interaction between the participant’s brain responses and the musical stimuli is established. We realized this concept technically in a functional prototype of an algorithm that generates continuous and controllable patterns of synthesized affective music in real-time, which is embedded within a BCI architecture. We evaluated our concept in two separate studies. In the first study, we tested the efficacy of our music algorithm by measuring subjective affective responses from 11 participants. In a second pilot study, the algorithm was embedded in a real-time BCI architecture to investigate affective closed-loop interactions in 5 participants. Preliminary results suggested that participants were able to intentionally modulate the musical feedback by self-inducing emotions (e.g., by recalling memories), suggesting that the system was able not only to capture the listener’s current affective state in real-time, but also potentially provide a tool for listeners to mediate their own emotions by interacting with music. The proposed concept offers a tool to study emotions in the loop, promising to cast a complementary light on emotion-related brain research, particularly in terms of clarifying the interactive, spatio-temporal dynamics underlying affective processing in the brain.

[Music therapy procedures controlled by the brain potentials in treatment of functional disorders]

Twenty years ago, the Korsakov's Journal of Neurology and Psychiatry has published the article of Ya.I. Levin 'Brain music in the treatment of patients with insomnia'. This publication was the starting point for an innovative approach to preventing and correcting functional disorders of a person via musical or music-like stimuli that are controlled by the brain potentials of patient's. This approach called 'Music of the brain' is fully consistent with modern ideas about preventive neuroscience as a new field of scientific research at the intersection of neuroscience and preventive medicine. In this review, the authors analyze initial studies on the effects of music on the brain and discuss their limitations. To increase the effectiveness of the approach, a unique combination of musical therapy with the neurofeedback method, the technology of musical neurofeedback, has been developed. Results of the application of developed technology for treatment of human functional disorders are presented, and promising directions for further research are outlined.