Mirror neurons: Functions, mechanisms and models

Goal-directed vocal planning in a songbird

Songbirds' vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs toward the target by about 1 standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.

Live vs video interaction: sensorimotor and visual cortical oscillations during action observation

Increasingly, in the field of communication, education, and business, people are switching to video interaction, and interlocutors frequently complain that the perception of nonverbal information and concentration suffer. We investigated this issue by analyzing electroencephalogram (EEG) oscillations of the sensorimotor (mu rhythm) and visual (alpha rhythm) cortex of the brain in an experiment with action observation live and on video. The mu rhythm reflects the activity of the mirror neuron system, and the occipital alpha rhythm shows the level of visual attention. We used 32-channel EEG recorded during live and video action observation in 83 healthy volunteers. The ICA method was used for selecting the mu- and alpha-components; the Fourier Transform was used to calculate the suppression index relative to the baseline (stationary demonstrator) of the rhythms. The main range of the mu rhythm was indeed sensitive to social movement and was highly dependent on the conditions of interaction-live or video. The upper mu-range appeared to be less sensitive to the conditions, but more sensitive to different movements. The alpha rhythm did not depend on the type of movement; however, a live performance initially caused a stronger concentration of visual attention. Thus, subtle social and nonverbal perceptions may suffer in remote video interactions.

Driving Hebbian plasticity over ventral premotor-motor projections transiently enhances motor resonance

BACKGROUND

Making sense of others' actions relies on the activation of an action observation network (AON), which maps visual information about observed actions onto the observer's motor system. This motor resonance process manifests in the primary motor cortex (M1) as increased corticospinal excitability finely tuned to the muscles engaged in the observed action. Motor resonance in M1 is facilitated by projections from higher-order AON regions. However, whether manipulating the strength of AON-to-M1 connectivity affects motor resonance remains unclear.

METHODS

We used transcranial magnetic stimulation (TMS) in 48 healthy humans. Cortico-cortical paired associative stimulation (ccPAS) was administered over M1 and the ventral premotor cortex (PMv), a key AON node, to induce spike-timing-dependent plasticity (STDP) in the pathway connecting them. Single-pulse TMS assessed motor resonance during action observation.

RESULTS

Before ccPAS, action observation increased corticospinal excitability in the muscles corresponding to the observed movements, reflecting motor resonance in M1. Notably, ccPAS aimed at strengthening projections from PMv to M1 (PMv→M1) induced short-term enhancement of motor resonance. The enhancement specifically occurred with the ccPAS configuration consistent with forward PMv→M1 projections and dissipated 20 min post-stimulation; ccPAS administered in the reverse order (M1→PMv) and sham stimulation did not affect motor resonance.

CONCLUSIONS

These findings provide the first evidence that inducing STDP to strengthen PMv input to M1 neurons causally enhances muscle-specific motor resonance in M1. Our study sheds light on the plastic mechanisms that shape AON functionality and demonstrates that exogenous manipulation of AON connectivity can influence basic mirror mechanisms that underlie social perception.

Aberrant modulation of broadband neural oscillations reflects vocal sensorimotor deficits in post-stroke aphasia

OBJECTIVE

The present study investigated the neural oscillatory correlates of impaired vocal sensorimotor control in left-hemisphere stroke.

METHODS

Electroencephalography (EEG) signals were recorded from 34 stroke and 46 control subjects during speech vowel vocalization and listening tasks under normal and pitch-shifted auditory feedback.

RESULTS

Time-frequency analyses revealed aberrantly decreased theta (4-8 Hz) and increased gamma band (30-80 Hz) power in frontal and posterior parieto-occipital regions as well as reduced alpha (8-13 Hz) and beta (13-30 Hz) desynchronization over sensorimotor areas before speech vowel vocalization in left-hemisphere stroke compared with controls. Subjects with the stroke also presented with aberrant modulation of broadband (4-80 Hz) neural oscillations over sensorimotor regions after speech vowel onset during vocalization and listening under normal and altered auditory feedback. We found that the atypical pattern of broadband neural oscillatory modulation was correlated with diminished vocal feedback error compensation behavior and the severity of co-existing language-related aphasia symptoms associated with left-hemisphere stroke.

CONCLUSIONS

These findings indicate complex interplays between the underlying mechanisms of speech and language and their deficits in post-stroke aphasia.

SIGNIFICANCE

Our data motivate the notion of studying neural oscillatory dynamics as a critical component for the examination of speech and language disorders in post-stroke aphasia.

Brain-Inspired Affective Empathy Computational Model and Its Application on Altruistic Rescue Task

Affective empathy is an indispensable ability for humans and other species' harmonious social lives, motivating altruistic behavior, such as consolation and aid-giving. How to build an affective empathy computational model has attracted extensive attention in recent years. Most affective empathy models focus on the recognition and simulation of facial expressions or emotional speech of humans, namely Affective Computing. However, these studies lack the guidance of neural mechanisms of affective empathy. From a neuroscience perspective, affective empathy is formed gradually during the individual development process: experiencing own emotion—forming the corresponding Mirror Neuron System (MNS)—understanding the emotions of others through the mirror mechanism. Inspired by this neural mechanism, we constructed a brain-inspired affective empathy computational model, this model contains two submodels: (1) We designed an Artificial Pain Model inspired by the Free Energy Principle (FEP) to the simulate pain generation process in living organisms. (2) We build an affective empathy spiking neural network (AE-SNN) that simulates the mirror mechanism of MNS and has self-other differentiation ability. We apply the brain-inspired affective empathy computational model to the pain empathy and altruistic rescue task to achieve the rescue of companions by intelligent agents. To the best of our knowledge, our study is the first one to reproduce the emergence process of mirror neurons and anti-mirror neurons in the SNN field. Compared with traditional affective empathy computational models, our model is more biologically plausible, and it provides a new perspective for achieving artificial affective empathy, which has special potential for the social robots field in the future.

Developing Intelligent Robots that Grasp Affordance

Humans and robots operating in unstructured environments both need to classify objects through haptic exploration and use them in various tasks, but currently they differ greatly in their strategies for acquiring such capabilities. This review explores nascent technologies that promise more convergence. A novel form of artificial intelligence classifies objects according to sensory percepts during active exploration and decides on efficient sequences of exploratory actions to identify objects. Representing objects according to the collective experience of manipulating them provides a substrate for discovering causality and affordances. Such concepts that generalize beyond explicit training experiences are an important aspect of human intelligence that has eluded robots. For robots to acquire such knowledge, they will need an extended period of active exploration and manipulation similar to that employed by infants. The efficacy, efficiency and safety of such behaviors depends on achieving smooth transitions between movements that change quickly from exploratory to executive to reflexive. Animals achieve such smoothness by using a hierarchical control scheme that is fundamentally different from those of conventional robotics. The lowest level of that hierarchy, the spinal cord, starts to self-organize during spontaneous movements in the fetus. This allows its connectivity to reflect the mechanics of the musculoskeletal plant, a bio-inspired process that could be used to adapt spinal-like middleware for robots. Implementation of these extended and essential stages of fetal and infant development is impractical, however, for mechatronic hardware that does not heal and replace itself like biological tissues. Instead such development can now be accomplished in silico and then cloned into physical robots, a strategy that could transcend human performance.

Does mental practice or mirror therapy help prevent functional loss after distal radius fracture? A randomized controlled trial

STUDY DESIGN

A randomized, single-blinded controlled trial.

INTRODUCTION

Therapy results after distal radius fractures (DRF) especially with older patients are often suboptimal. One possible approach for counteracting the problems are motor-cognitive training interventions such as Mental Practice (MP) or Mirror Therapy (MT), which may be applied in early rehabilitation without stressing the injured wrist.

PURPOSE OF THE STUDY

The aim of the study is to investigate the effects of MP and MT on wrist function after DRF. The pilot study should furthermore provide information about the feasibility of these methods.

METHODS

Thirty-one women were assigned either to one of the two experimental groups (MP, MT) or to a control group (relaxation intervention). The participants completed a training for six weeks, administered at their homes. Measurements were taken at four times (weeks 0, 3, 6 and 12) to document the progression in subjective function (PRWE, QuickDASH) and objective constraints of the wrist (ROM, grip strength) as well as in health-related quality of life (EQ-5D).

RESULTS

The results indicated that both experimental groups showed higher improvements across the intervention period compared to the control group; e.g. PRWE: MT 74.0%, MP 66.2%, CG 56.9%. While improvements in grip strength were higher for the MP group, the MT group performed better in all other measures. However, time by group interactions approached significance at best; e.g. ROM: P = .076; η_p² = .141.

CONCLUSION

The superiority of MP as well as MT supports the simulation theory. Motor-cognitive intervention programs are feasible and promising therapy supplements, which may be applied in early rehabilitation to counteract the consequences of immobilization without stressing the injured wrist.

Imitation and mirror systems in robots through Deep Modality Blending Networks

Learning to interact with the environment not only empowers the agent with manipulation capability but also generates information to facilitate building of action understanding and imitation capabilities. This seems to be a strategy adopted by biological systems, in particular primates, as evidenced by the existence of mirror neurons that seem to be involved in multi-modal action understanding. How to benefit from the interaction experience of the robots to enable understanding actions and goals of other agents is still a challenging question. In this study, we propose a novel method, deep modality blending networks (DMBN), that creates a common latent space from multi-modal experience of a robot by blending multi-modal signals with a stochastic weighting mechanism. We show for the first time that deep learning, when combined with a novel modality blending scheme, can facilitate action recognition and produce structures to sustain anatomical and effect-based imitation capabilities. Our proposed system, which is based on conditional neural processes, can be conditioned on any desired sensory/motor value at any time step, and can generate a complete multi-modal trajectory consistent with the desired conditioning in one-shot by querying the network for all the sampled time points in parallel avoiding the accumulation of prediction errors. Based on simulation experiments with an arm-gripper robot and an RGB camera, we showed that DMBN could make accurate predictions about any missing modality (camera or joint angles) given the available ones outperforming recent multimodal variational autoencoder models in terms of long-horizon high-dimensional trajectory predictions. We further showed that given desired images from different perspectives, i.e. images generated by the observation of other robots placed on different sides of the table, our system could generate image and joint angle sequences that correspond to either anatomical or effect-based imitation behavior. To achieve this mirror-like behavior, our system does not perform a pixel-based template matching but rather benefits from and relies on the common latent space constructed by using both joint and image modalities, as shown by additional experiments. Moreover, we showed that mirror learning (in our system) does not only depend on visual experience and cannot be achieved without proprioceptive experience. Our experiments showed that out of ten training scenarios with different initial configurations, the proposed DMBN model could achieve mirror learning in all of the cases where the model that only uses visual information failed in half of them. Overall, the proposed DMBN architecture not only serves as a computational model for sustaining mirror neuron-like capabilities, but also stands as a powerful machine learning architecture for high-dimensional multi-modal temporal data with robust retrieval capabilities operating with partial information in one or multiple modalities.

Insula cortex gates the interplay of action observation and preparation for controlled imitation

Perceiving, anticipating and responding to the actions of another person are fundamentally entwined processes such that seeing another's movement can prompt automatic imitation, as in social mimicry and contagious yawning. Yet the direct-matching of others' movements is not always appropriate, so this tendency must be controlled. This necessitates the hierarchical integration of the systems for action mirroring with domain-general control networks. Here we use functional magnetic resonance imaging (fMRI) and computational modelling to examine the top-down and context-dependent modulation of mirror representations and their influence on motor planning. Participants performed actions that either intentionally or incidentally imitated, or counter-imitated, an observed action. Analyses of these fMRI data revealed a region in the mid-occipital gyrus (MOG) where activity differed between imitation versus counter-imitation in a manner that depended on whether this was intentional or incidental. To identify broader cortical network mechanisms underlying this interaction between intention and imitativeness, we used dynamic causal modelling to pose specific hypotheses which embody assumptions about inter-areal interactions and contextual modulations. These models each incorporated four regions - medial temporal V5 (early motion perception), MOG (action-observation), supplementary motor area (action planning), and anterior insula (executive control) - but differ in their interactions and hierarchical structure. The best model of our data afforded a crucial role for the anterior insula, gating the interaction of supplementary motor area and MOG activity. This provides a novel brain network-based account of task-dependent control over the integration of motor planning and mirror systems, with mirror responses suppressed for intentional counter-imitation.

No evidence for somatosensory attenuation during action observation of self-touch

The discovery of mirror neurons in the macaque brain in the 1990s triggered investigations on putative human mirror neurons and their potential functionality. The leading proposed function has been action understanding: Accordingly, we understand the actions of others by 'simulating' them in our own motor system through a direct matching of the visual information to our own motor programmes. Furthermore, it has been proposed that this simulation involves the prediction of the sensory consequences of the observed action, similar to the prediction of the sensory consequences of our executed actions. Here, we tested this proposal by quantifying somatosensory attenuation behaviourally during action observation. Somatosensory attenuation manifests during voluntary action and refers to the perception of self-generated touches as less intense than identical externally generated touches because the self-generated touches are predicted from the motor command. Therefore, we reasoned that if an observer simulates the observed action and, thus, he/she predicts its somatosensory consequences, then he/she should attenuate tactile stimuli simultaneously delivered to his/her corresponding body part. In three separate experiments, we found a systematic attenuation of touches during executed self-touch actions, but we found no evidence for attenuation when such actions were observed. Failure to observe somatosensory attenuation during observation of self-touch is not compatible with the hypothesis that the putative human mirror neuron system automatically predicts the sensory consequences of the observed action. In contrast, our findings emphasize a sharp distinction between the motor representations of self and others.

How Do We Motorically Resonate in Aging? A Compensatory Role of Prefrontal Cortex

Aging is the major risk factor for chronic age-related neurological diseases such as neurodegenerative disorders and neurovascular injuries. Exploiting the multimodal nature of the Mirror Neuron System (MNS), rehabilitative interventions have been proposed based on motor-resonance mechanisms in recent years. Despite the considerable evidence of the MNS’ functionality in young adults, further investigation of the action-observation matching system is required in aging, where well-known structural and functional brain changes occur. Twenty-one healthy young adults (mean age 26.66y) and 19 healthy elderly participants (mean age 71.47y) underwent a single MRI evaluation including a T1-3D high-resolution and functional MRI (fMRI) with mirror task. Morphological and functional BOLD data were derived from MRI images to highlight cortical activations associated with the task; to detect differences between the two groups (Young, Elderly) in the two MRI indexes (BOLD and thickness z-scores) using mixed factorial ANOVA (Group^∗Index analyses); and to investigate the presence of different cortical lateralization of the BOLD signal in the two groups. In the entire sample, the activation of a bilateral MNS fronto-parietal network was highlighted. The mixed ANOVA (pFDR-corr < 0.05) revealed significant interactions between BOLD signal and cortical thickness in left dorsal premotor cortex, right ventral premotor and prefrontal cortices. A different cortical lateralization of the BOLD signal in frontal lobe activity between groups was also found. Data herein reported suggest that age-related cortical thinning of the MNS is coupled with increased interhemispheric symmetry along with premotor and prefrontal cortex recruitment. These physiological changes of MNS resemble the aging of the motor and cognitive neural systems, suggesting specific but also common aging and compensatory mechanisms.

Brain solutions for hearing problems during the COVID-19 pandemic and the misery of wearing a mask

BACKGROUND

In COVID-19 pandemics days, wearing facial mask in public places has become obligatory to prevent the virus spread. In addition to its valuable protection, wearing facial mask can affect verbal communication in an adverse fashion and makes mutual understanding difficult. This happens because the mask eliminates the positive effect of the lip-reading phenomenon in direct communications. The mirror neuron system is responsible for automatic imitation, associative sequence learning, and motor mimicry. This system is a strong candidate justifying an unexpected action described in this article.

PURPOSE

Taking the facial mask off, to help the listener understanding better is a normal reaction. However, unexpectedly, one does the same as the listener when he/she is unable to comprehend the speaker. Herein, we suggest a hypothesis proposing the basic role of Mirror neuron system in this action. Most of the research on these cells have been conducted on monkeys, where the researchers observed that, these neuron discharge pulses both when a monkey performs an action and when it observes another monkey or a person committing the similar action.

CONCLUSION

The driving mechanism of an unanticipated action of taking off mask while listening to a speaker is emphasized in this paper. Herein, we try to clarify how we came up with the idea that mirror neuron system drives a surprising action observed in COVID-19 pandemics days. As a result, we suggest possible clinical studies to verify our hypothesis.

Investigation of the Sense of Agency in Social Cognition, Based on Frameworks of Predictive Coding and Active Inference: A Simulation Study on Multimodal Imitative Interaction

When agents interact socially with different intentions (or wills), conflicts are difficult to avoid. Although the means by which social agents can resolve such problems autonomously has not been determined, dynamic characteristics of agency may shed light on underlying mechanisms. Therefore, the current study focused on the sense of agency, a specific aspect of agency referring to congruence between the agent's intention in acting and the outcome, especially in social interaction contexts. Employing predictive coding and active inference as theoretical frameworks of perception and action generation, we hypothesize that regulation of complexity in the evidence lower bound of an agent's model should affect the strength of the agent's sense of agency and should have a significant impact on social interactions. To evaluate this hypothesis, we built a computational model of imitative interaction between a robot and a human via visuo-proprioceptive sensation with a variational Bayes recurrent neural network, and simulated the model in the form of pseudo-imitative interaction using recorded human body movement data, which serve as the counterpart in the interactions. A key feature of the model is that the complexity of each modality can be regulated differently by changing the values of a hyperparameter assigned to each local module of the model. We first searched for an optimal setting of hyperparameters that endow the model with appropriate coordination of multimodal sensation. These searches revealed that complexity of the vision module should be more tightly regulated than that of the proprioception module because of greater uncertainty in visual information flow. Using this optimally trained model as a default model, we investigated how changing the tightness of complexity regulation in the entire network after training affects the strength of the sense of agency during imitative interactions. The results showed that with looser regulation of complexity, an agent tends to act more egocentrically, without adapting to the other. In contrast, with tighter regulation, the agent tends to follow the other by adjusting its intention. We conclude that the tightness of complexity regulation significantly affects the strength of the sense of agency and the dynamics of interactions between agents in social settings.

Weighted Brain Network Metrics for Decoding Action Intention Understanding Based on EEG

Background: Understanding the action intentions of others is important for social and human-robot interactions. Recently, many state-of-the-art approaches have been proposed for decoding action intention understanding. Although these methods have some advantages, it is still necessary to design other tools that can more efficiently classify the action intention understanding signals. New Method: Based on EEG, we first applied phase lag index (PLI) and weighted phase lag index (WPLI) to construct functional connectivity matrices in five frequency bands and 63 micro-time windows, then calculated nine graph metrics from these matrices and subsequently used the network metrics as features to classify different brain signals related to action intention understanding. Results: Compared with the single methods (PLI or WPLI), the combination method (PLI+WPLI) demonstrates some overwhelming victories. Most of the average classification accuracies exceed 70%, and some of them approach 80%. In statistical tests of brain network, many significantly different edges appear in the frontal, occipital, parietal, and temporal regions. Conclusions: Weighted brain networks can effectively retain data information. The integrated method proposed in this study is extremely effective for investigating action intention understanding. Both the mirror neuron and mentalizing systems participate as collaborators in the process of action intention understanding.

An Attention-Controlled Hand Exoskeleton for the Rehabilitation of Finger Extension and Flexion Using a Rigid-Soft Combined Mechanism

Hand rehabilitation exoskeletons are in need of improving key features such as simplicity, compactness, bi-directional actuation, low cost, portability, safe human-robotic interaction, and intuitive control. This article presents a brain-controlled hand exoskeleton based on a multi-segment mechanism driven by a steel spring. Active rehabilitation training is realized using a threshold of the attention value measured by an electroencephalography (EEG) sensor as a brain-controlled switch for the hand exoskeleton. We present a prototype implementation of this rigid-soft combined multi-segment mechanism with active training and provide a preliminary evaluation. The experimental results showed that the proposed mechanism could generate enough range of motion with a single input by distributing an actuated linear motion into the rotational motions of finger joints during finger flexion/extension. The average attention value in the experiment of concentration with visual guidance was significantly higher than that in the experiment without visual guidance. The feasibility of the attention-based control with visual guidance was proven with an overall exoskeleton actuation success rate of 95.54% (14 human subjects). In the exoskeleton actuation experiment using the general threshold, it performed just as good as using the customized thresholds; therefore, a general threshold of the attention value can be set for a certain group of users in hand exoskeleton activation.

The complexity of understanding others as the evolutionary origin of empathy and emotional contagion

Contagious yawning, emotional contagion and empathy are characterized by the activation of similar neurophysiological states or responses in an observed individual and an observer. For example, it is hard to keep one’s mouth closed when imagining someone yawning, or not feeling distressed while observing other individuals perceiving pain. The evolutionary origin of these widespread phenomena is unclear, since a direct benefit is not always apparent. We explore a game theoretical model for the evolution of mind-reading strategies, used to predict and respond to others’ behavior. In particular we explore the evolutionary scenarios favoring simulative strategies, which recruit overlapping neural circuits when performing as well as when observing a specific behavior. We show that these mechanisms are advantageous in complex environments, by allowing an observer to use information about its own behavior to interpret that of others. However, without inhibition of the recruited neural circuits, the observer would perform the corresponding downstream action, rather than produce the appropriate social response. We identify evolutionary trade-offs that could hinder this inhibition, leading to emotional contagion as a by-product of mind-reading. The interaction of this model with kinship is complex. We show that empathy likely evolved in a scenario where kin- and other indirect benefits co-opt strategies originally evolved for mind-reading, and that this model explains observed patterns of emotional contagion with kin or group members.

Do Not Neglect the Body and Action: The Emergence of Embodiment Approaches to Understanding Human Development

It is becoming clear that to truly understand what it is to be human, focusing scientific efforts on the mind alone is insufficient. We are embodied minds, living and acting in a world full of meaningful things. In this article, we discuss how science has been informed by important research insights into the close relationship between the body, the mind, and the world. These interactions can be translated into embodied perspectives of human development. We provide evidence that perception, cognition, emotion, human relations, and behavior are grounded in our bodies from the beginning of our lives. From this perspective, the body cannot be assumed to be simply an effector for cognition or an instrument for collecting information for the brain. This comprehensive review and debate of embodied-related literature is accompanied by the identification of theoretical challenges and practical applications that will shape research for years to come.

Psychophysiological effects of audiovisual stimuli during cycle exercise

Immersive environments induced by audiovisual stimuli are hypothesised to facilitate the control of movements and ameliorate fatigue-related symptoms during exercise. The objective of the present study was to investigate the effects of pleasant and unpleasant audiovisual stimuli on perceptual and psychophysiological responses during moderate-intensity exercises performed on an electromagnetically braked cycle ergometer. Twenty young adults were administered three experimental conditions in a randomised and counterbalanced order: unpleasant stimulus (US; e.g. images depicting laboured breathing); pleasant stimulus (PS; e.g. images depicting pleasant emotions); and neutral stimulus (NS; e.g. neutral facial expressions). The exercise had 10 min of duration (2 min of warm-up + 6 min of exercise + 2 min of warm-down). During all conditions, the rate of perceived exertion and heart rate variability were monitored to further understanding of the moderating influence of audiovisual stimuli on perceptual and psychophysiological responses, respectively. The results of the present study indicate that PS ameliorated fatigue-related symptoms and reduced the physiological stress imposed by the exercise bout. Conversely, US increased the global activity of the autonomic nervous system and increased exertional responses to a greater degree when compared to PS. Accordingly, audiovisual stimuli appear to induce a psychophysiological response in which individuals visualise themselves within the story presented in the video. In such instances, individuals appear to copy the behaviour observed in the videos as if the situation was real. This mirroring mechanism has the potential to up-/down-regulate the cardiac work as if in fact the exercise intensities were different in each condition.

A review: Motor rehabilitation after stroke with control based on human intent

Strokes are a leading cause of acquired disability worldwide, and there is a significant need for novel interventions and further research to facilitate functional motor recovery in stroke patients. This article reviews motor rehabilitation methods for stroke survivors with a focus on rehabilitation controlled by human motor intent. The review begins with the neurodevelopmental principles of motor rehabilitation that provide the neuroscientific basis for intuitively controlled rehabilitation, followed by a review of methods allowing human motor intent detection, biofeedback approaches, and quantitative motor rehabilitation assessment. Challenges for future advances in motor rehabilitation after stroke using intuitively controlled approaches are addressed.

Intentionally not imitating: Insula cortex engaged for top-down control of action mirroring

Perception and action are inextricably linked, down to the level of single cells which have both visual and motor response properties - dubbed 'mirror neurons'. The mirror neuron system is generally associated with direct-matching or resonance between observed and executed actions (and goals). Yet in everyday interactions responding to another's movements with matching actions (or goals) is not always appropriate. Here we examine processes associated with intentionally not imitating, as separable from merely detecting an observed action as mismatching one's own. Using fMRI, we test how matched and mismatched stimulus-response mapping for actions is modulated depending on task-relevance. Participants were either cued to intentionally copy or oppose a presented action (intentional imitation or counter-imitation), or cued to perform a predefined action regardless of the presented action (incidental imitation or counter-imitation). We found distinct cortical networks underlying imitation compared to counter-imitation, involving areas typically associated with an action observation network and widespread occipital activation. Intentionally counter-imitating particularly involved frontal-parietal networks, including the insula and cingulate cortices. This task-dependent recruitment of frontal networks for the intentional selection of opposing responses supports previous evidence for the preparatory suppression of imitative responses. Sensorimotor mirroring is modulated via control processes, which complex human interactions often require.

Cognitive and neuroimaging findings in developmental coordination disorder: new insights from a systematic review of recent research

AIM

To better understand the neural and performance factors that may underlie developmental coordination disorder (DCD), and implications for a multi-component account.

METHOD

A systematic review of the experimental literature published between June 2011 and September 2016 was conducted using a modified PICOS (population, intervention, comparison, outcomes, and study type) framework. A total of 106 studies were included.

RESULTS

Behavioural data from 91 studies showed a broad cluster of deficits in the anticipatory control of movement, basic processes of motor learning, and cognitive control. Importantly, however, performance issues in DCD were often shown to be moderated by task type and difficulty. As well, we saw new evidence of compensatory processes and strategies in several studies. Neuroimaging data (15 studies, including electroencephalography) showed reduced cortical thickness in the right medial orbitofrontal cortex and altered brain activation patterns across functional networks involving prefrontal, parietal, and cerebellar regions in children with DCD than those in comparison groups. Data from diffusion-weighted magnetic resonance imaging suggested reduced white matter organization involving sensorimotor structures and altered structural connectivity across the whole brain network.

INTERPRETATION

Taken together, results support the hypothesis that children with DCD show differences in brain structure and function compared with typically developing children. Behaviourally, these differences may affect anticipatory planning and reduce automatization of movement skill, prompting greater reliance on slower feedback-based control and compensatory strategies. Implications for future research, theory development, and clinical practice are discussed.

Robots As Intentional Agents: Using Neuroscientific Methods to Make Robots Appear More Social

Robots are increasingly envisaged as our future cohabitants. However, while considerable progress has been made in recent years in terms of their technological realization, the ability of robots to interact with humans in an intuitive and social way is still quite limited. An important challenge for social robotics is to determine how to design robots that can perceive the user's needs, feelings, and intentions, and adapt to users over a broad range of cognitive abilities. It is conceivable that if robots were able to adequately demonstrate these skills, humans would eventually accept them as social companions. We argue that the best way to achieve this is using a systematic experimental approach based on behavioral and physiological neuroscience methods such as motion/eye-tracking, electroencephalography, or functional near-infrared spectroscopy embedded in interactive human-robot paradigms. This approach requires understanding how humans interact with each other, how they perform tasks together and how they develop feelings of social connection over time, and using these insights to formulate design principles that make social robots attuned to the workings of the human brain. In this review, we put forward the argument that the likelihood of artificial agents being perceived as social companions can be increased by designing them in a way that they are perceived as intentional agents that activate areas in the human brain involved in social-cognitive processing. We first review literature related to social-cognitive processes and mechanisms involved in human-human interactions, and highlight the importance of perceiving others as intentional agents to activate these social brain areas. We then discuss how attribution of intentionality can positively affect human-robot interaction by (a) fostering feelings of social connection, empathy and prosociality, and by (b) enhancing performance on joint human-robot tasks. Lastly, we describe circumstances under which attribution of intentionality to robot agents might be disadvantageous, and discuss challenges associated with designing social robots that are inspired by neuroscientific principles.

Spatial and viewpoint selectivity for others' observed actions in monkey ventral premotor mirror neurons

The spatial location and viewpoint of observed actions are closely linked in natural social settings. For example, actions observed from a subjective viewpoint necessarily occur within the observer’s peripersonal space. Neurophysiological studies have shown that mirror neurons (MNs) of the monkey ventral premotor area F5 can code the spatial location of live observed actions. Furthermore, F5 MN discharge can also be modulated by the viewpoint from which filmed actions are seen. Nonetheless, whether and to what extent MNs can integrate viewpoint and spatial location of live observed actions remains unknown. We addressed this issue by comparing the activity of 148 F5 MNs while macaque monkeys observed an experimenter grasping in three different combinations of viewpoint and spatial location, namely, lateral view in the (1) extrapersonal and (2) peripersonal space and (3) subjective view in the peripersonal space. We found that the majority of MNs were space-selective (60.8%): those selective for the peripersonal space exhibited a preference for the subjective viewpoint both at the single-neuron and population level, whereas space-unselective neurons were view invariant. These findings reveal the existence of a previously neglected link between spatial and viewpoint selectivity in MN activity during live-action observation.

Beta rhythm modulation by speech sounds: somatotopic mapping in somatosensory cortex

During speech listening motor regions are somatotopically activated, resembling the activity that subtends actual speech production, suggesting that motor commands can be retrieved from sensory inputs. Crucially, the efficient motor control of the articulators relies on the accurate anticipation of the somatosensory reafference. Nevertheless, evidence about somatosensory activities elicited by auditory speech processing is sparse. The present work looked for specific interactions between auditory speech presentation and somatosensory cortical information processing. We used an auditory speech identification task with sounds having different place of articulation (bilabials and dentals). We tested whether coupling the auditory task with a peripheral electrical stimulation of the lips would affect the pattern of sensorimotor electroencephalographic rhythms. Peripheral electrical stimulation elicits a series of spectral perturbations of which the beta rebound reflects the return-to-baseline stage of somatosensory processing. We show a left-lateralized and selective reduction in the beta rebound following lip somatosensory stimulation when listening to speech sounds produced with the lips (i.e. bilabials). Thus, the somatosensory processing could not return to baseline due to the recruitment of the same neural resources by speech stimuli. Our results are a clear demonstration that heard speech sounds are somatotopically mapped onto somatosensory cortices, according to place of articulation.

The Extended Mirror Neuron Network

Mirror neurons (MNs) are a fascinating class of cells originally discovered in the ventral premotor cortex (PMv) and, subsequently, in the inferior parietal lobule (IPL) of the macaque, which become active during both the execution and observation of actions. In this review, I will first highlight the mounting evidence indicating that mirroring others’ actions engages a broad system of reciprocally connected cortical areas, which extends well beyond the classical IPL-PMv circuit and might even include subcortical regions such as the basal ganglia. Then, I will present the most recent findings supporting the idea that the observation of one’s own actions, which might play a role in the ontogenetic origin and tuning of MNs, retains a particular relevance within the adult MN system. Finally, I will propose that both cortical and subcortical mechanisms do exist to decouple MN activity from the motor output, in order to render it exploitable for high-order perceptual, cognitive, and even social functions. The findings reviewed here provide an original framework for envisaging the main challenges and experimental directions of future neurophysiological and neuroanatomical studies of the monkey MN system.

Methodologies, Models and Algorithms for Patients Rehabilitation

INTRODUCTION

This editorial is part of the Focus Theme of Methods of Information in Medicine on "Methodologies, Models and Algorithms for Patients Rehabilitation".

OBJECTIVE

The objective of this focus theme is to present current solutions by means of technologies and human factors related to the use of Information and Communication Technologies (ICT) for improving patient rehabilitation.

METHODS

The focus theme examines distinctive measurements of strengthening methodologies, models and algorithms for disabled people in terms of rehabilitation and health care, and to explore the extent to which ICT is a useful tool in this process.

RESULTS

The focus theme records a set of solutions for ICT systems developed to improve the rehabilitation process of disabled people and to help them in carrying out their daily life.

CONCLUSIONS

The development and subsequent setting up of computers for the patients' rehabilitation process is of continuous interest and growth.

Eye Gaze Correlates of Motor Impairment in VR Observation of Motor Actions

INTRODUCTION

This article is part of the Focus Theme of Methods of Information in Medicine on "Methodologies, Models and Algorithms for Patients Rehabilitation".

OBJECTIVE

Identify eye gaze correlates of motor impairment in a virtual reality motor observation task in a study with healthy participants and stroke patients.

METHODS

Participants consisted of a group of healthy subjects (N = 20) and a group of stroke survivors (N = 10). Both groups were required to observe a simple reach-and-grab and place-and-release task in a virtual environment. Additionally, healthy subjects were required to observe the task in a normal condition and a constrained movement condition. Eye movements were recorded during the observation task for later analysis.

RESULTS

For healthy participants, results showed differences in gaze metrics when comparing the normal and arm-constrained conditions. Differences in gaze metrics were also found when comparing dominant and non-dominant arm for saccades and smooth pursuit events. For stroke patients, results showed longer smooth pursuit segments in action observation when observing the paretic arm, thus providing evidence that the affected circuitry may be activated for eye gaze control during observation of the simulated motor action.

CONCLUSIONS

This study suggests that neural motor circuits are involved, at multiple levels, in observation of motor actions displayed in a virtual reality environment. Thus, eye tracking combined with action observation tasks in a virtual reality display can be used to monitor motor deficits derived from stroke, and consequently can also be used for rehabilitation of stroke patients.

Processing of Own Hand Visual Feedback during Object Grasping in Ventral Premotor Mirror Neurons

Mirror neurons (MNs) discharge during action execution as well as during observation of others' actions. Our own actions are those that we have the opportunity to observe more frequently, but no study thus far to our knowledge has addressed the issue of whether, and to what extent, MNs can code own hand visual feedback (HVF) during object grasping. Here, we show that MNs of the ventral premotor area F5 of macaque monkeys are particularly sensitive to HVF relative to non-MNs simultaneously recorded in the same penetrations. Importantly, the HVF effect is more evident on MN activity during hand-object interaction than during the hand-shaping phase. Furthermore, the increase of MN activity induced by HVF and others' actions observed from a subjective perspective were positively correlated. These findings indicate that at least part of ventral premotor MNs can process the visual information coming from own hand interacting with objects, likely playing a role in self-action monitoring.

SIGNIFICANCE STATEMENT

We show that mirror neurons (MNs) of area F5 of the macaque, in addition to encoding others' observed actions, are particularly sensitive, relative to simultaneously recorded non-MNs, to the sight of the monkey's own hand during object grasping, likely playing a role in self-action monitoring.

Towards a Computational Comparative Neuroprimatology: Framing the language-ready brain

We make the case for developing a Computational Comparative Neuroprimatology to inform the analysis of the function and evolution of the human brain. First, we update the mirror system hypothesis on the evolution of the language-ready brain by (i) modeling action and action recognition and opportunistic scheduling of macaque brains to hypothesize the nature of the last common ancestor of macaque and human (LCA-m); and then we (ii) introduce dynamic brain modeling to show how apes could acquire gesture through ontogenetic ritualization, hypothesizing the nature of evolution from LCA-m to the last common ancestor of chimpanzee and human (LCA-c). We then (iii) hypothesize the role of imitation, pantomime, protosign and protospeech in biological and cultural evolution from LCA-c to Homo sapiens with a language-ready brain. Second, we suggest how cultural evolution in Homo sapiens led from protolanguages to full languages with grammar and compositional semantics. Third, we assess the similarities and differences between the dorsal and ventral streams in audition and vision as the basis for presenting and comparing two models of language processing in the human brain: A model of (i) the auditory dorsal and ventral streams in sentence comprehension; and (ii) the visual dorsal and ventral streams in defining "what language is about" in both production and perception of utterances related to visual scenes provide the basis for (iii) a first step towards a synthesis and a look at challenges for further research.

No evidence for mirror system dysfunction in schizophrenia from a multimodal TMS/EEG study

Dysfunctional mirror neuron systems have been proposed to contribute to the social cognitive deficits observed in schizophrenia. A few studies have explored mirror systems in schizophrenia using various techniques such as TMS (levels of motor resonance) or EEG (levels of mu suppression), with mixed results. This study aimed to use a novel multimodal approach (i.e. concurrent TMS and EEG) to further investigate mirror systems and social cognition in schizophrenia. Nineteen individuals with schizophrenia or schizoaffective disorder and 19 healthy controls participated. Single-pulse TMS was applied to M1 during the observation of hand movements designed to elicit mirror system activity. Single EEG electrodes (C3, CZ, C4) recorded brain activity. Participants also completed facial affect recognition and theory of mind tasks. The schizophrenia group showed significant deficits in facial affect recognition and higher level theory of mind compared to healthy controls. A significant positive relationship was revealed between mu suppression and motor resonance for the overall sample, indicating concurrent validity of these measures. Levels of mu suppression and motor resonance were not significantly different between groups. These findings indicate that in stable outpatients with schizophrenia, mirror system functioning is intact, and therefore their social cognitive difficulties may be caused by alternative pathophysiology.

Video stimuli reduce object-directed imitation accuracy: a novel two-person motion-tracking approach

Imitation is an important form of social behavior, and research has aimed to discover and explain the neural and kinematic aspects of imitation. However, much of this research has featured single participants imitating in response to pre-recorded video stimuli. This is in spite of findings that show reduced neural activation to video vs. real life movement stimuli, particularly in the motor cortex. We investigated the degree to which video stimuli may affect the imitation process using a novel motion tracking paradigm with high spatial and temporal resolution. We recorded 14 positions on the hands, arms, and heads of two individuals in an imitation experiment. One individual freely moved within given parameters (moving balls across a series of pegs) and a second participant imitated. This task was performed with either simple (one ball) or complex (three balls) movement difficulty, and either face-to-face or via a live video projection. After an exploratory analysis, three dependent variables were chosen for examination: 3D grip position, joint angles in the arm, and grip aperture. A cross-correlation and multivariate analysis revealed that object-directed imitation task accuracy (as represented by grip position) was reduced in video compared to face-to-face feedback, and in complex compared to simple difficulty. This was most prevalent in the left-right and forward-back motions, relevant to the imitator sitting face-to-face with the actor or with a live projected video of the same actor. The results suggest that for tasks which require object-directed imitation, video stimuli may not be an ecologically valid way to present task materials. However, no similar effects were found in the joint angle and grip aperture variables, suggesting that there are limits to the influence of video stimuli on imitation. The implications of these results are discussed with regards to previous findings, and with suggestions for future experimentation.

Functional Properties of Parietal Hand Manipulation–related Neurons and Mirror Neurons Responding to Vision of Own Hand Action

Parietofrontal pathways play an important role in visually guided motor control. In this pathway, hand manipulation-related neurons in the inferior parietal lobule represent 3-D properties of an object and motor patterns to grasp it. Furthermore, mirror neurons show visual responses that are concerned with the actions of others and motor-related activity during execution of the same grasping action. Because both of these categories of neurons integrate visual and motor signals, these neurons may play a role in motor control based on visual feedback signals. The aim of this study was to investigate whether these neurons in inferior parietal lobule including the anterior intraparietal area and PFG of macaques represent visual images of the monkey's own hand during a self-generated grasping action. We recorded 235 neurons related to hand manipulation tasks. Of these, 54 responded to video clips of the monkey's own hand action, the same as visual feedback during that action or clips of the experimenter's hand action in a lateral view. Of these 54 neurons, 25 responded to video clips of the monkey's own hand, even without an image of the target object. We designated these 25 neurons as “hand-type.” Thirty-three of 54 neurons that were defined as mirror neurons showed visual responses to the experimenter's action and motor responses. Thirteen of these mirror neurons were classified as hand-type. These results suggest that activity of hand manipulation-related and mirror neurons in anterior intraparietal/PFG plays a fundamental role in monitoring one's own body state based on visual feedback.

Imitative Neural Mechanism-Based Behavior Intention Recognition System in Human–Robot Interaction

This paper is concerned with an imitative neural mechanism for recognizing behavior intention in human–robot interaction system. The intention recognition process is inspired by the neural mechanism of the mirror neurons in macaque monkey brain. We try to renovate a standard neural network with parametric biases as a reference model to imitate between sensory-motor data pair. The imitation process is primarily directed toward reproducing the goals of observed actions rather than the exact action trajectories. Several experiments and their results show that the proposed model allows to develop useful robotic application for human–robot interaction system application.

Information processing in the mirror neuron system in primates and machines

The mirror neuron system in primates matches observations of actions with the motor representations used for their execution, and is a topic of intense research and debate in biological and computational disciplines. In robotics, models of this system have been used for enabling robots to imitate and learn how to perform tasks from human demonstrations. Yet, existing computational and robotic models of these systems are found in multiple levels of description, and although some models offer plausible explanations and testable predictions, the difference in the granularity of the experimental setups, methodologies, computational structures and selected modeled data make principled meta-analyses, common in other fields, difficult. In this paper, we adopt an interdisciplinary approach, using the BODB integrated environment in order to bring together several different but complementary computational models, by functionally decomposing them into brain operating principles (BOPs) which each capture a limited subset of the model's functionality. We then explore links from these BOPs to neuroimaging and neurophysiological data in order to pinpoint complementary and conflicting explanations and compare predictions against selected sets of neurobiological data. The results of this comparison are used to interpret mirror system neuroimaging results in terms of neural network activity, evaluate the biological plausibility of mirror system models, and suggest new experiments that can shed light on the neural basis of mirror systems.

The concepts of representation and information in explanatory theories of human behavior

Focusing in experimental study of human behavior, this article discusses the concepts of information and mental representation aiming the integration of their biological, computational, and semantic aspects. Assuming that the objective of any communication process is ultimately to modify the receiver's state, the term correlational information is proposed as a measure of how changes occurring in external world correlate with changes occurring inside an individual. Mental representations are conceptualized as a special case of information processing in which correlational information is received, recorded, but also modified by a complex emergent process of associating new elements. In humans, the acquisition of information and creation of mental representations occurs in a two-step process. First, a sufficiently complex brain structure is necessary to establishing internal states capable to co-vary with external events. Second, the validity or meaning of these representations must be gradually achieved by confronting them with the environment. This contextualization can be considered as part of the process of ascribing meaning to information and representations. The hypothesis introduced here is that the sophisticated psychological constructs classically associated with the concept of mental representation are essentially of the same nature of simple interactive behaviors. The capacity of generating elaborated mental phenomena like beliefs and desires emerges gradually during evolution and, in a given individual, by learning and social interaction.

Limb apraxia and verb processing in Alzheimer's disease

OBJECTIVE

The present research investigates language and praxis abilities in patients with Alzheimer's disease in order to study the relationship between these two cognitive domains.

METHOD

The experimental evaluation of patients and control group performance was designed to permit a direct comparison of linguistic abilities (i.e., verb and noun naming and sentence comprehension) and praxic abilities (i.e., gesture execution for complex movements). Moreover, for the first time, action comprehension was explored using the Action Sequence Comprehension.

RESULTS AND CONCLUSION

Analyses of variance (ANOVAs) and correlational analyses showed that a direct relationship may exist between language impairment and apraxia in patients with Alzheimer's disease. In addition, the production and comprehension of both language and action were equally impaired in patients, providing further evidence for a spectrum of concomitant linguistic and praxis deficits in Alzheimer's disease. Finally, the ability to correctly comprehend action semantics was related more directly to verb production ability than to noun production.

The role of mirror neurons in language acquisition and evolution

I argue that Cook et al.'s attack of the genetic hypothesis of mirror neurons misses its target because the authors miss the point that genetics may specify how neurons may learn, not what they learn. Paying more attention to recent work linking mirror neurons to language acquisition and evolution would strengthen Cook et al.'s arguments against a rigid genetic hypothesis.

Hebbian learning and predictive mirror neurons for actions, sensations and emotions

Spike-timing-dependent plasticity is considered the neurophysiological basis of Hebbian learning and has been shown to be sensitive to both contingency and contiguity between pre- and postsynaptic activity. Here, we will examine how applying this Hebbian learning rule to a system of interconnected neurons in the presence of direct or indirect re-afference (e.g. seeing/hearing one's own actions) predicts the emergence of mirror neurons with predictive properties. In this framework, we analyse how mirror neurons become a dynamic system that performs active inferences about the actions of others and allows joint actions despite sensorimotor delays. We explore how this system performs a projection of the self onto others, with egocentric biases to contribute to mind-reading. Finally, we argue that Hebbian learning predicts mirror-like neurons for sensations and emotions and review evidence for the presence of such vicarious activations outside the motor system.