Neural decoding of expressive human movement from scalp electroencephalography (EEG)

The Neuroscience of Dance: A Conceptual Framework and Systematic Review

Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.

Integrating Statistical and Machine Learning Approaches for Neural Classification

Neurons can code for multiple variables simultaneously and neuroscientists are often interested in classifying neurons based on their receptive field properties. Statistical models provide powerful tools for determining the factors influencing neural spiking activity and classifying individual neurons. However, as neural recording technologies have advanced to produce simultaneous spiking data from massive populations, classical statistical methods often lack the computational efficiency required to handle such data. Machine learning (ML) approaches are known for enabling efficient large scale data analyses; however, they typically require massive training sets with balanced data, along with accurate labels to fit well. Additionally, model assessment and interpretation are often more challenging for ML than for classical statistical methods. To address these challenges, we develop an integrated framework, combining statistical modeling and machine learning approaches to identify the coding properties of neurons from large populations. In order to demonstrate this framework, we apply these methods to data from a population of neurons recorded from rat hippocampus to characterize the distribution of spatial receptive fields in this region.

Dance movement therapy for neurodegenerative diseases: A systematic review

Background

The proportion of the world's elderly population continues to rise, and the treatment and improvement of neurodegenerative diseases have become issue of public health importance as people live longer and many countries have aging populations. This systematic review aims to discuss the effects of dance movement therapy (DMT) on motor function, cognitive deficit, mood, and quality of life in people with neurodegenerative diseases, such as Parkinson's disease (PD), mild cognitive impairment (MCI), Alzheimer's disease (AD).

Methods

Two reviewers independently conducted systematic search on the Cochrane library, PubMed database, Web of Science Core Collection database, and Physiotherapy Evidence database until February 1, 2022. Only systematic analyses and randomized controlled trials were included and further analyzed.

Results

Thirty-three studies on PD, 16 studies on MCI, 4 studies on AD were obtained. This systematic review found that DMT substantially improved the global cognitive function, memory, and executive function on the population with MCI. Compared with the non-dance group, DMT remarkably improved general disease condition, balance, and gait for individuals with PD. The evidence of the efficacy of DMT on AD is insufficient, and further research is needed.

Conclusion

DMT can effectively improve the motor function and cognitive deficits in neurodegenerative diseases. Positive effects of DMT on the mood and quality of life in ND patients are controversial and require further evidence. Future research on the effects of DMT on AD requires scientific design, large sample size, long-term comprehensive intervention, and clear reporting standards.

Systematic review registration

www.osf.io/wktez, identifier: 10.17605/OSF.IO/UYBKT.

Redesigning navigational aids using virtual global landmarks to improve spatial knowledge retrieval

Although beacon- and map-based spatial strategies are the default strategies for navigation activities, today's navigational aids mostly follow a beacon-based design where one is provided with turn-by-turn instructions. Recent research, however, shows that our reliance on these navigational aids is causing a decline in our spatial skills. We are processing less of our surrounding environment and relying too heavily on the instructions given. To reverse this decline, we need to engage more in map-based learning, which encourages the user to process and integrate spatial knowledge into a cognitive map built to benefit flexible and independent spatial navigation behaviour. In an attempt to curb our loss of skills, we proposed a navigation assistant to support map-based learning during active navigation. Called the virtual global landmark (VGL) system, this augmented reality (AR) system is based on the kinds of techniques used in traditional orienteering. Specifically, a notable landmark is always present in the user's sight, allowing the user to continuously compute where they are in relation to that specific location. The efficacy of the unit as a navigational aid was tested in an experiment with 27 students from the University of Technology Sydney via a comparison of brain dynamics and behaviour. From an analysis of behaviour and event-related spectral perturbation, we found that participants were encouraged to process more spatial information with a map-based strategy where a silhouette of the compass-like landmark was perpetually in view. As a result of this technique, they consistently navigated with greater efficiency and better accuracy.

Sex-Specific Brain Responses to Imaginary Dance but Not Physical Dance: An Electroencephalography Study of Functional Connectivity and Electrical Brain Activity

To date, most neurophysiological dance research has been conducted exclusively with female participants in observational studies (i.e., participants observe or imagine a dance choreography). In this regard, the sex-specific acute neurophysiological effect of physically executed dance can be considered a widely unexplored field of research. This study examines the acute impact of a modern jazz dance choreography on brain activity and functional connectivity using electroencephalography (EEG). In a within-subject design, 11 female and 11 male participants were examined under four test conditions: physically dancing the choreography with and without music and imagining the choreography with and without music. Prior to the EEG measurements, the participants acquired the choreography over 3 weeks with one session per week. Subsequently, the participants conducted all four test conditions in a randomized order on a single day, with the EEG measurements taken before and after each condition. Differences between the male and female participants were established in brain activity and functional connectivity analyses under the condition of imagined dance without music. No statistical differences between sexes were found in the other three conditions (physically executed dance with and without music as well as imagined dance with music). Physically dancing and music seem to have sex-independent effects on the human brain. However, thinking of dance without music seems to be rather sex-specific. The results point to a promising approach to decipher sex-specific differences in the use of dance or music. This approach could further be used to achieve a more group-specific or even more individualized and situationally adapted use of dance interventions, e.g., in the context of sports, physical education, or therapy. The extent to which the identified differences are due to culturally specific attitudes in the sex-specific contact with dance and music needs to be clarified in future research.

Mirror Neuron Activity During Audiovisual Appreciation of Opera Performance

Opera is a performing art in which music plays the leading role, and the acting of singers has a synergistic effect with the music. The mirror neuron system represents the neurophysiological mechanism underlying the coupling of perception and action. Mirror neuron activity is modulated by the appropriateness of actions and clarity of intentions, as well as emotional expression and aesthetic values. Therefore, it would be reasonable to assume that an opera performance induces mirror neuron activity in the audience so that the performer effectively shares an embodied performance with the audience. However, it is uncertain which aspect of opera performance induces mirror neuron activity. It is hypothesized that although auditory stimuli could induce mirror neuron activity, audiovisual perception of stage performance is the primary inducer of mirror neuron activity. To test this hypothesis, this study sought to correlate opera performance with brain activity as measured by electroencephalography (EEG) in singers while watching an opera performance with sounds or while listening to an aria without visual stimulus. We detected mirror neuron activity by observing that the EEG power in the alpha frequency band (8-13 Hz) was selectively decreased in the frontal-central-parietal area when watching an opera performance. In the auditory condition, however, the alpha-band power did not change relative to the resting condition. This study illustrates that the audiovisual perception of an opera performance engages the mirror neuron system in its audience.

Dance on the Brain: Enhancing Intra- and Inter-Brain Synchrony

Dance has traditionally been viewed from a Eurocentric perspective as a mode of self-expression that involves the human body moving through space, performed for the purposes of art, and viewed by an audience. In this Hypothesis and Theory article, we synthesize findings from anthropology, sociology, psychology, dance pedagogy, and neuroscience to propose The Synchronicity Hypothesis of Dance, which states that humans dance to enhance both intra- and inter-brain synchrony. We outline a neurocentric definition of dance, which suggests that dance involves neurobehavioral processes in seven distinct areas including sensory, motor, cognitive, social, emotional, rhythmic, and creative. We explore The Synchronicity Hypothesis of Dance through several avenues. First, we examine evolutionary theories of dance, which suggest that dance drives interpersonal coordination. Second, we examine fundamental movement patterns, which emerge throughout development and are omnipresent across cultures of the world. Third, we examine how each of the seven neurobehaviors increases intra- and inter-brain synchrony. Fourth, we examine the neuroimaging literature on dance to identify the brain regions most involved in and affected by dance. The findings presented here support our hypothesis that we engage in dance for the purpose of intrinsic reward, which as a result of dance-induced increases in neural synchrony, leads to enhanced interpersonal coordination. This hypothesis suggests that dance may be helpful to repattern oscillatory activity, leading to clinical improvements in autism spectrum disorder and other disorders with oscillatory activity impairments. Finally, we offer suggestions for future directions and discuss the idea that our consciousness can be redefined not just as an individual process but as a shared experience that we can positively influence by dancing together.

Electrical Brain Activity and Its Functional Connectivity in the Physical Execution of Modern Jazz Dance

Besides the pure pleasure of watching a dance performance, dance as a whole-body movement is becoming increasingly popular for health-related interventions. However, the science-based evidence for improvements in health or well-being through dance is still ambiguous and little is known about the underlying neurophysiological mechanisms. This may be partly related to the fact that previous studies mostly examined the neurophysiological effects of imagination and observation of dance rather than the physical execution itself. The objective of this pilot study was to investigate acute effects of a physically executed dance with its different components (recalling the choreography and physical activity to music) on the electrical brain activity and its functional connectivity using electroencephalographic (EEG) analysis. Eleven dance-inexperienced female participants first learned a Modern Jazz Dance (MJD) choreography over three weeks (1 h sessions per week). Afterwards, the acute effects on the EEG brain activity were compared between four different test conditions: physically executing the MJD choreography with music, physically executing the choreography without music, imaging the choreography with music, and imaging the choreography without music. Every participant passed each test condition in a randomized order within a single day. EEG rest-measurements were conducted before and after each test condition. Considering time effects the physically executed dance without music revealed in brain activity analysis most increases in alpha frequency and in functional connectivity analysis in all frequency bands. In comparison, physically executed dance with music as well as imagined dance with music led to fewer increases and imagined dance without music provoked noteworthy brain activity and connectivity decreases at all frequency bands. Differences between the test conditions were found in alpha and beta frequency between the physically executed dance and the imagined dance without music as well as between the physically executed dance with and without music in the alpha frequency. The study highlights different effects of a physically executed dance compared to an imagined dance on many brain areas for all measured frequency bands. These findings provide first insights into the still widely unexplored field of neurological effects of dance and encourages further research in this direction.

Developing Precision Invasive Neuromodulation for Psychiatry

Psychiatric conditions are common and often disabling. Although great strides have been made in alleviating symptoms with pharmacotherapy and psychotherapeutic approaches, many patients continue to have severe disease burden despite the best therapies available. One of the pervasive challenges to improving treatment is that present diagnostic and therapeutic strategies lag behind our modern conceptualization of the pathophysiology of these disorders. Psychiatric symptoms manifest through activity in specific neural circuits; thus, therapies capable of modulating these circuits are attractive. The investigators reviewed recent advances that facilitate treating medically refractory psychiatric disorders with intracranial neuromodulation in a way that intervenes more directly with the underlying pathophysiology. Specifically, they reviewed the prospects for using intracranial multielectrode arrays to record brain activity with high spatiotemporal resolution and identify circuit-level electrophysiological correlates of symptoms. A causal relationship of circuit electrophysiology to symptoms could then be established by modulating the circuits to disrupt the symptoms. Personalized therapeutic neuromodulation strategies can then proceed in a rational manner with stimulation protocols informed by the underlying circuit-based pathophysiology of the most bothersome symptoms. This strategy would enhance current methods in neurotherapeutics by identifying individualized anatomical targets with symptom-specific precision, circumventing many of the limitations inherent in modern psychiatric nosology and treatment.

Shared Prosthetic Control Based on Multiple Movement Intent Decoders

SIGNIFICANCE

A number of movement intent decoders exist in the literature that typically differ in the algorithms used and the nature of the outputs generated. Each approach comes with its own advantages and disadvantages. Combining the estimates of multiple algorithms may have better performance than any of the individual methods.

OBJECTIVE

This paper presents and evaluates a shared controller framework for prosthetic limbs based on multiple decoders of volitional movement intent.

METHODS

An algorithm to combine multiple estimates to control the prosthesis is developed in this paper. The capabilities of the approach are validated using a system that combines a Kalman filter-based decoder with a multilayer perceptron classifier-based decoder. The shared controller's performance is validated in online experiments where a virtual limb is controlled in real-time by amputee and intact-arm subjects. During the testing phase subjects controlled a virtual hand in real time to move digits to instructed positions using either a Kalman filter decoder, a multilayer perceptron decoder, or a linear combination of the two.

RESULTS

The shared controller results in statistically significant improvements over the component decoders. Specifically, certain degrees of shared control result in increases in the time-in-target metric and decreases in unintended movements.

CONCLUSION

The shared controller of this paper combines the good qualities of component decoders tested in this paper. Herein, combining a Kalman filter decoder with a classifier-based decoder inherits the flexibility of the Kalman filter decoder and the limited unwanted movements from the classifier-based decoder, resulting in a system that may be able to perform the tasks of everyday life more naturally and reliably.

Mobile brain/body Imaging in dance: A dynamic transdisciplinary field for applied research

Neuroscience of dance is an emerging field with important applications related to health and well-being, as dance has shown potential to foster adaptive neuroplasticity and is increasingly popular as a therapeutic activity or adjunct therapy for people living with conditions such as Parkinson's and Alzheimer's diseases. However, the multimodal nature of dance presents challenges to researchers aiming to identify mechanisms involved when dance is used to combat neurodegeneration or support healthy ageing. Requiring simultaneous engagement of motor and cognitive domains, dancing includes coordination of systems involved in timing, memory and spatial learning. Studies on dance to this point rely primarily on assessments of brain dynamics and structure through pre/post-tests or studies on expertise, as traditional brain imaging modalities restrict participant movement to avoid movement-related artefacts. In this paper, we describe the process of designing and implementing a study that uses mobile brain/body imaging (MoBI) to investigate real-time changes in brain dynamics and behaviour during the process of learning and performing a novel dance choreography. We show the potential for new insights to emerge from the coordinated collection of movement and brain-based data, and the implications of these in an emerging field whose medium is motion.

Imaging the human hippocampus with optically-pumped magnetoencephalography

Optically-pumped (OP) magnetometers allow magnetoencephalography (MEG) to be performed while a participant's head is unconstrained. To fully leverage this new technology, and in particular its capacity for mobility, the activity of deep brain structures which facilitate explorative behaviours such as navigation, must be detectable using OP-MEG. One such crucial brain region is the hippocampus. Here we had three healthy adult participants perform a hippocampal-dependent task - the imagination of novel scene imagery - while being scanned using OP-MEG. A conjunction analysis across these three participants revealed a significant change in theta power in the medial temporal lobe. The peak of this activated cluster was located in the anterior hippocampus. We repeated the experiment with the same participants in a conventional SQUID-MEG scanner and found similar engagement of the medial temporal lobe, also with a peak in the anterior hippocampus. These OP-MEG findings indicate exciting new opportunities for investigating the neural correlates of a range of crucial cognitive functions in naturalistic contexts including spatial navigation, episodic memory and social interactions.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

How Shall I Count the Ways? A Method for Quantifying the Qualitative Aspects of Unscripted Movement With Laban Movement Analysis

There is significant clinical evidence showing that creative and expressive movement processes involved in dance/movement therapy (DMT) enhance psycho-social well-being. Yet, because movement is a complex phenomenon, statistically validating which aspects of movement change during interventions or lead to significant positive therapeutic outcomes is challenging because movement has multiple, overlapping variables appearing in unique patterns in different individuals and situations. One factor contributing to the therapeutic effects of DMT is movement's effect on clients' emotional states. Our previous study identified sets of movement variables which, when executed, enhanced specific emotions. In this paper, we describe how we selected movement variables for statistical analysis in that study, using a multi-stage methodology to identify, reduce, code, and quantify the multitude of variables present in unscripted movement. We suggest a set of procedures for using Laban Movement Analysis (LMA)-described movement variables as research data. Our study used LMA, an internationally accepted comprehensive system for movement analysis, and a primary DMT clinical assessment tool for describing movement. We began with Davis's (1970) three-stepped protocol for analyzing movement patterns and identifying the most important variables: (1) We repeatedly observed video samples of validated (Atkinson et al., 2004) emotional expressions to identify prevalent movement variables, eliminating variables appearing minimally or absent. (2) We use the criteria repetition, frequency, duration and emphasis to eliminate additional variables. (3) For each emotion, we analyzed motor expression variations to discover how variables cluster: first, by observing ten movement samples of each emotion to identify variables common to all samples; second, by qualitative analysis of the two best-recognized samples to determine if phrasing, duration or relationship among variables was significant. We added three new steps to this protocol: (4) we created Motifs (LMA symbols) combining movement variables extracted in steps 1-3; (5) we asked participants in the pilot study to move these combinations and quantify their emotional experience. Based on the results of the pilot study, we eliminated more variables; (6) we quantified the remaining variables' prevalence in each Motif for statistical analysis that examined which variables enhanced each emotion. We posit that our method successfully quantified unscripted movement data for statistical analysis.

Mobile EEG in research on neurodevelopmental disorders: Opportunities and challenges

Mobile electroencephalography (mobile EEG) represents a next-generation neuroscientific technology – to study real-time brain activity – that is relatively inexpensive, non-invasive and portable. Mobile EEG leverages state-of-the-art hardware alongside established advantages of traditional EEG and recent advances in signal processing. In this review, we propose that mobile EEG could open unprecedented possibilities for studying neurodevelopmental disorders. We first present a brief overview of recent developments in mobile EEG technologies, emphasising the proliferation of studies in several neuroscientific domains. As these developments have yet to be exploited by neurodevelopmentalists, we then identify three research opportunities: 1) increase in the ease and flexibility of brain data acquisition in neurodevelopmental populations; 2) integration into powerful developmentally-informative research designs; 3) development of innovative non-stationary EEG-based paradigms. Critically, we address key challenges that should be considered to fully realise the potential of mobile EEG for neurodevelopmental research and for understanding developmental psychopathology more broadly, and suggest future research directions.

Dynamics of directional tuning and reference frames in humans: A high-density EEG study

Recent developments in EEG recording and signal processing have made it possible to record in an unconstrained, natural movement task, therefore EEG provides a promising approach to understanding the neural mechanisms of upper-limb reaching control. This study specifically addressed how EEG dynamics in the time domain encoded finger movement directions (directional tuning) and posture dependence (movement reference frames) by applying representational similarity analysis. High-density EEG covering the entire scalp was recorded while participants performed eight-directional, center-out reaching movements, thereby allowing us to explore directional selectivity of EEG sources over the brain beyond somatosensory areas. A majority of the source processes exhibited statistically significant directional tuning during peri-movement periods. In addition, directional tuning curves shifted systematically when the shoulder angle was rotated to perform the task within a more laterally positioned workspace, the degree of tuning curve rotation falling between that predicted by models assuming extrinsic and shoulder-based reference frames. We conclude that temporal dynamics of neural mechanisms for motor control can be studied noninvasively in humans using high-density EEG and that directional sensitivity of motor and non-motor processing is not limited within the sensorimotor areas but extends to the whole brain areas.

The Dancing Brain: Structural and Functional Signatures of Expert Dance Training

Dance - as a ritual, therapy, and leisure activity - has been known for thousands of years. Today, dance is increasingly used as therapy for cognitive and neurological disorders such as dementia and Parkinson's disease. Surprisingly, the effects of dance training on the healthy young brain are not well understood despite the necessity of such information for planning successful clinical interventions. Therefore, this study examined actively performing, expert-level trained college students as a model of long-term exposure to dance training. To study the long-term effects of dance training on the human brain, we compared 20 young expert female Dancers with normal body mass index with 20 age- and education-matched Non-Dancers with respect to brain structure and function. We used diffusion tensor, morphometric, resting state and task-related functional MRI, a broad cognitive assessment, and objective measures of selected dance skill (Dance Central video game and a balance task). Dancers showed superior performance in the Dance Central video game and balance task, but showed no differences in cognitive abilities. We found little evidence for training-related differences in brain volume in Dancers. Dancers had lower anisotropy in the corticospinal tract. They also activated the action observation network (AON) to greater extent than Non-Dancers when viewing dance sequences. Dancers showed altered functional connectivity of the AON, and of the general motor learning network. These functional connectivity differences were related to dance skill and balance and training-induced structural characteristics. Our findings have the potential to inform future study designs aiming to monitor dance training-induced plasticity in clinical populations.

Deployment of Mobile EEG Technology in an Art Museum Setting: Evaluation of Signal Quality and Usability

Electroencephalography (EEG) has emerged as a powerful tool for quantitatively studying the brain that enables natural and mobile experiments. Recent advances in EEG have allowed for the use of dry electrodes that do not require a conductive medium between the recording electrode and the scalp. The overall goal of this research was to gain an understanding of the overall usability and signal quality of dry EEG headsets compared to traditional gel-based systems in an unconstrained environment. EEG was used to collect Mobile Brain-body Imaging (MoBI) data from 432 people as they experienced an art exhibit in a public museum. The subjects were instrumented with either one of four dry electrode EEG systems or a conventional gel electrode EEG system. Each of the systems was evaluated based on the signal quality and usability in a real-world setting. First, we describe the various artifacts that were characteristic of each of the systems. Second, we report on each system's usability and their limitations in a mobile setting. Third, to evaluate signal quality for task discrimination and characterization, we employed a data driven clustering approach on the data from 134 of the 432 subjects (those with reliable location tracking information and usable EEG data) to evaluate the power spectral density (PSD) content of the EEG recordings. The experiment consisted of a baseline condition in which the subjects sat quietly facing a white wall for 1 min. Subsequently, the participants were encouraged to explore the exhibit for as long as they wished (piece-viewing). No constraints were placed upon the individual in relation to action, time, or navigation of the exhibit. In this freely-behaving approach, the EEG systems varied in their capacity to record characteristic modulations in the EEG data, with the gel-based system more clearly capturing stereotypical alpha and beta-band modulations.

A convolutional neural network for steady state visual evoked potential classification under ambulatory environment

The robust analysis of neural signals is a challenging problem. Here, we contribute a convolutional neural network (CNN) for the robust classification of a steady-state visual evoked potentials (SSVEPs) paradigm. We measure electroencephalogram (EEG)-based SSVEPs for a brain-controlled exoskeleton under ambulatory conditions in which numerous artifacts may deteriorate decoding. The proposed CNN is shown to achieve reliable performance under these challenging conditions. To validate the proposed method, we have acquired an SSVEP dataset under two conditions: 1) a static environment, in a standing position while fixated into a lower-limb exoskeleton and 2) an ambulatory environment, walking along a test course wearing the exoskeleton (here, artifacts are most challenging). The proposed CNN is compared to a standard neural network and other state-of-the-art methods for SSVEP decoding (i.e., a canonical correlation analysis (CCA)-based classifier, a multivariate synchronization index (MSI), a CCA combined with k-nearest neighbors (CCA-KNN) classifier) in an offline analysis. We found highly encouraging SSVEP decoding results for the CNN architecture, surpassing those of other methods with classification rates of 99.28% and 94.03% in the static and ambulatory conditions, respectively. A subsequent analysis inspects the representation found by the CNN at each layer and can thus contribute to a better understanding of the CNN’s robust, accurate decoding abilities.

Tracking Plasticity: Effects of Long-Term Rehearsal in Expert Dancers Encoding Music to Movement

Our knowledge of neural plasticity suggests that neural networks show adaptation to environmental and intrinsic change. In particular, studies investigating the neuroplastic changes associated with learning and practicing motor tasks have shown that practicing such tasks results in an increase in neural activation in several specific brain regions. However, studies comparing experts and non-experts suggest that experts employ less neuronal activation than non-experts when performing a familiar motor task. Here, we aimed to determine the long-term changes in neural networks associated with learning a new dance in professional ballet dancers over 34 weeks. Subjects visualized dance movements to music while undergoing fMRI scanning at four time points over 34-weeks. Results demonstrated that initial learning and performance at seven weeks led to increases in activation in cortical regions during visualization compared to the first week. However, at 34 weeks, the cortical networks showed reduced activation compared to week seven. Specifically, motor learning and performance over the 34 weeks showed the typical inverted-U-shaped function of learning. Further, our result demonstrate that learning of a motor sequence of dance movements to music in the real world can be visualized by expert dancers using fMRI and capture highly significant modeled fits of the brain network variance of BOLD signals from early learning to expert level performance.

Emotion Regulation through Movement: Unique Sets of Movement Characteristics are Associated with and Enhance Basic Emotions

We have recently demonstrated that motor execution, observation, and imagery of movements expressing certain emotions can enhance corresponding affective states and therefore could be used for emotion regulation. But which specific movement(s) should one use in order to enhance each emotion? This study aimed to identify, using Laban Movement Analysis (LMA), the Laban motor elements (motor characteristics) that characterize movements whose execution enhances each of the basic emotions: anger, fear, happiness, and sadness. LMA provides a system of symbols describing its motor elements, which gives a written instruction (motif) for the execution of a movement or movement-sequence over time. Six senior LMA experts analyzed a validated set of video clips showing whole body dynamic expressions of anger, fear, happiness and sadness, and identified the motor elements that were common to (appeared in) all clips expressing the same emotion. For each emotion, we created motifs of different combinations of the motor elements common to all clips of the same emotion. Eighty subjects from around the world read and moved those motifs, to identify the emotion evoked when moving each motif and to rate the intensity of the evoked emotion. All subjects together moved and rated 1241 motifs, which were produced from 29 different motor elements. Using logistic regression, we found a set of motor elements associated with each emotion which, when moved, predicted the feeling of that emotion. Each emotion was predicted by a unique set of motor elements and each motor element predicted only one emotion. Knowledge of which specific motor elements enhance specific emotions can enable emotional self-regulation through adding some desired motor qualities to one's personal everyday movements (rather than mimicking others' specific movements) and through decreasing motor behaviors which include elements that enhance negative emotions.

Classification of finger vibrotactile input using scalp EEG

While there are many output brain-computer interface (output BCIs) studies, few have examined the input pathway, namely decoding the sensory input. To examine the possibility of building a BCI with sensory input using scalp electroencephalography (EEG), this study builds a classifier based on Local Fisher Discriminant Analysis (LFDA) and Gaussian Mixture Model (GMM) to classify neural activity generated by vibrotactile sensory stimuli delivered to the fingers. Small vibrators were placed on the fingertips of the participant. They vibrated one by one in a random sequence while the participant sat still with eyes closed. EEG data were recorded and later used to classify which finger was vibrated. There were two tasks: one focusing on differentiating between ipsilateral fingers, the other one focusing on differentiating contralateral fingers. Decoding accuracies were high in both tasks: 97.6% and 99.3% respectively. Event-related EEG features in both amplitude and power domain are discussed.

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Understanding typical and atypical development remains one of the fundamental questions in developmental human neuroscience. Traditionally, experimental paradigms and analysis tools have been limited to constrained laboratory tasks and contexts due to technical limitations imposed by the available set of measuring and analysis techniques and the age of the subjects. These limitations severely limit the study of developmental neural dynamics and associated neural networks engaged in cognition, perception and action in infants performing “in action and in context”. This protocol presents a novel approach to study infants and young children as they freely organize their own behavior, and its consequences in a complex, partly unpredictable and highly dynamic environment. The proposed methodology integrates synchronized high-density active scalp electroencephalography (EEG), inertial measurement units (IMUs), video recording and behavioral analysis to capture brain activity and movement non-invasively in freely-behaving infants. This setup allows for the study of neural network dynamics in the developing brain, in action and context, as these networks are recruited during goal-oriented, exploration and social interaction tasks.

Decoding of intentional actions from scalp electroencephalography (EEG) in freely-behaving infants

The mirror neuron system (MNS) in humans is thought to enable an individual's understanding of the meaning of actions performed by others and the potential imitation and learning of those actions. In humans, electroencephalographic (EEG) changes in sensorimotor a-band at central electrodes, which desynchronizes both during execution and observation of goal-directed actions (i.e., μ suppression), have been considered an analog to MNS function. However, methodological and developmental issues, as well as the nature of generalized μ suppression to imagined, observed, and performed actions, have yet to provide a mechanistic relationship between EEG μ-rhythm and MNS function, and the extent to which EEG can be used to infer intent during MNS tasks remains unknown. In this study we present a novel methodology using active EEG and inertial sensors to record brain activity and behavioral actions from freely-behaving infants during exploration, imitation, attentive rest, pointing, reaching and grasping, and interaction with an actor. We used 5-band (1-4Hz) EEG as input to a dimensionality reduction algorithm (locality-preserving Fisher's discriminant analysis, LFDA) followed by a neural classifier (Gaussian mixture models, GMMs) to decode the each MNS task performed by freely-behaving 6-24 month old infants during interaction with an adult actor. Here, we present results from a 20-month male infant to illustrate our approach and show the feasibility of EEG-based classification of freely occurring MNS behaviors displayed by an infant. These results, which provide an alternative to the μ-rhythm theory of MNS function, indicate the informative nature of EEG in relation to intentionality (goal) for MNS tasks which may support action-understanding and thus bear implications for advancing the understanding of MNS function.

A lower limb exoskeleton control system based on steady state visual evoked potentials

OBJECTIVE

We have developed an asynchronous brain-machine interface (BMI)-based lower limb exoskeleton control system based on steady-state visual evoked potentials (SSVEPs).

APPROACH

By decoding electroencephalography signals in real-time, users are able to walk forward, turn right, turn left, sit, and stand while wearing the exoskeleton. SSVEP stimulation is implemented with a visual stimulation unit, consisting of five light emitting diodes fixed to the exoskeleton. A canonical correlation analysis (CCA) method for the extraction of frequency information associated with the SSVEP was used in combination with k-nearest neighbors.

MAIN RESULTS

Overall, 11 healthy subjects participated in the experiment to evaluate performance. To achieve the best classification, CCA was first calibrated in an offline experiment. In the subsequent online experiment, our results exhibit accuracies of 91.3 ± 5.73%, a response time of 3.28 ± 1.82 s, an information transfer rate of 32.9 ± 9.13 bits/min, and a completion time of 1100 ± 154.92 s for the experimental parcour studied.

SIGNIFICANCE

The ability to achieve such high quality BMI control indicates that an SSVEP-based lower limb exoskeleton for gait assistance is becoming feasible.

Identifying enhanced cortico-basal ganglia loops associated with prolonged dance training

Studies have revealed that prolonged, specialized training combined with higher cognitive conditioning induces enhanced brain alternation. In particular, dancers with long-term dance experience exhibit superior motor control and integration with their sensorimotor networks. However, little is known about the functional connectivity patterns of spontaneous intrinsic activities in the sensorimotor network of dancers. Our study examined the functional connectivity density (FCD) of dancers with a mean period of over 10 years of dance training in contrast with a matched non-dancer group without formal dance training using resting-state fMRI scans. FCD was mapped and analyzed, and the functional connectivity (FC) analyses were then performed based on the difference of FCD. Compared to the non-dancers, the dancers exhibited significantly increased FCD in the precentral gyri, postcentral gyri and bilateral putamen. Furthermore, the results of the FC analysis revealed enhanced connections between the middle cingulate cortex and the bilateral putamen and between the precentral and the postcentral gyri. All findings indicated an enhanced functional integration in the cortico-basal ganglia loops that govern motor control and integration in dancers. These findings might reflect improved sensorimotor function for the dancers consequent to long-term dance training.

Sitting and standing intention can be decoded from scalp EEG recorded prior to movement execution

Low frequency signals recorded from non-invasive electroencephalography (EEG), in particular movement-related cortical potentials (MRPs), are associated with preparation and execution of movement and thus present a target for use in brain-machine interfaces. We investigated the ability to decode movement intent from delta-band (0.1-4 Hz) EEG recorded immediately before movement execution in healthy volunteers. We used data from epochs starting 1.5 s before movement onset to classify future movements into one of three classes: stand-up, sit-down, or quiet. We assessed classification accuracy in both externally triggered and self-paced paradigms. Movement onset was determined from electromyography (EMG) recordings synchronized with EEG signals. We employed an artifact subspace reconstruction (ASR) algorithm to eliminate high amplitude noise before building our time-embedded EEG features. We applied local Fisher's discriminant analysis to reduce the dimensionality of our spatio-temporal features and subsequently used a Gaussian mixture model classifier for our three class problem. Our results demonstrate significantly better than chance classification accuracy (chance level = 33.3%) for the self-initiated (78.0 ± 2.6%) and triggered (74.7 ± 5.7%) paradigms. Surprisingly, we found no significant difference in classification accuracy between the self-paced and cued paradigms when using the full set of non-peripheral electrodes. However, accuracy was significantly increased for self-paced movements when only electrodes over the primary motor area were used. Overall, this study demonstrates that delta-band EEG recorded immediately before movement carries discriminative information regarding movement type. Our results suggest that EEG-based classifiers could improve lower-limb neuroprostheses and neurorehabilitation techniques by providing earlier detection of movement intent, which could be used in robot-assisted strategies for motor training and recovery of function.