Live vs video interaction: sensorimotor and visual cortical oscillations during action observation

Increasingly, in the field of communication, education, and business, people are switching to video interaction, and interlocutors frequently complain that the perception of nonverbal information and concentration suffer. We investigated this issue by analyzing electroencephalogram (EEG) oscillations of the sensorimotor (mu rhythm) and visual (alpha rhythm) cortex of the brain in an experiment with action observation live and on video. The mu rhythm reflects the activity of the mirror neuron system, and the occipital alpha rhythm shows the level of visual attention. We used 32-channel EEG recorded during live and video action observation in 83 healthy volunteers. The ICA method was used for selecting the mu- and alpha-components; the Fourier Transform was used to calculate the suppression index relative to the baseline (stationary demonstrator) of the rhythms. The main range of the mu rhythm was indeed sensitive to social movement and was highly dependent on the conditions of interaction-live or video. The upper mu-range appeared to be less sensitive to the conditions, but more sensitive to different movements. The alpha rhythm did not depend on the type of movement; however, a live performance initially caused a stronger concentration of visual attention. Thus, subtle social and nonverbal perceptions may suffer in remote video interactions.

Mu Desynchronisation in Autistic Individuals: What We Know and What We Need to Know

Autism spectrum disorder (ASD) is a neurodevelopmental condition that includes social-communication deficits and repetitive and stereotypical behaviours (APA 2022). Neurobiological methods of studying ASD are a promising methodology for identifying ASD biomarkers. Mu rhythms (Mu) have the potential to shed light on the socialisation deficits that characterise ASD; however, Mu/ASD studies thus far have yielded inconsistent results. This review examines the existing Mu/ASD studies to determine where this variability lies to elucidate potential factors that can be addressed in future studies.

Infants’ Prediction of Humanoid Robot’s Goal-Directed Action

Several studies have shown that infants anticipate human goal-directed actions, but not robot’s ones. However, the studies focusing on the robot goal-directed actions have mainly analyzed the effect of mechanical arms on infant’s attention. To date, the prediction of goal-directed actions in infants has not yet been studied when the agent is a humanoid robot. Given this lack of evidence in infancy research, the present study aims at analyzing infants’ action anticipation of both a human’s and a humanoid robot’s goal-directed action. Data were acquired on thirty 17-month-old infants, watching four video clips, where either a human or a humanoid robot performed a goal-directed action, i.e. reaching a target. Infants looking behavior was measured through the eye-tracking technique. The results showed that infants anticipated the goal-directed action of both the human and the robot and there were no differences in the anticipatory gaze behavior between the two agents. Furthermore, the findings indicated different attentional patterns for the human and the robot, showing a greater attention paid to the robot's face than the human’s face. Overall, the results suggest that 17-month-old infants may infer also humanoid robot’ underlying action goals.

Differential motor system entrainment to auditory and visual rhythms

Perception of, and synchronization to, auditory rhythms is known to be more accurate than with flashing visual rhythms. The motor system is known to play a role in the processing of timing information for auditory rhythm perception, but it is unclear if the motor system plays the same role for visual rhythm perception. One demonstrated component of auditory rhythm perception is neural entrainment at the frequency of the auditory rhythm. In this study, we use EEG to measure the entrainment of both auditory and visual rhythms from the motor cortex while subjects either tapped in synchrony with or passively attended to the presented rhythms. To isolate activity from motor cortex, we used independent component analysis to first separate out neural sources, then selected components using a combination of component topography, dipole location, mu activation, and beta modulation. This process took advantage of the fact that tapping activity results in reduced mu power, and characteristic beta modulation, which helped select motor components. Our findings suggest neural entrainment in motor components was stronger for visual rhythms than auditory rhythms and strongest during the tapping conditions for both modalities. We also find mu power increased in response to both auditory and visual rhythms. These findings indicate that the generally greater rhythm perception capabilities of the auditory system over the visual system may not depend entirely on neural entrainment in the motor system, but rather how the motor system is able to use the timing information made available to it. NEW & NOTEWORTHY We investigated neural entrainment in the motor system for both auditory and visual isochronous rhythms using electroencephalogram. Counter to expectations, our findings suggest stronger entrainment for visual rhythms than for auditory rhythms. Motor system activity was isolated with a novel procedure using independent component analysis as a means of blind source separation, along with known markers of mu activity from the motor system to identify motor components.

Sensorimotor anticipation of others' actions in real-world and video settings: modulation by level of engagement?

Electroencephalography (EEG) studies investigating social cognition have used both video and real-world stimuli, often without a strong reasoning why one or the other was chosen. Video stimuli can be selected for practical reasons, while naturalistic real-world stimuli are ecologically valid. The current study investigated modulatory effects on EEG mu (8 - 13 Hz) suppression, directly prior to the onset - and during the course - of observed actions, related to real-world and video settings. Recordings were made over sensorimotor cortex and stimuli in both settings consisted of identical (un)predictable object-related grasping and placing actions. In both settings a very similar mu suppression was found during unfolding of the action, irrespective of predictability. However, mu suppression related to the anticipation of upcoming predictable actions was found exclusively in the real-world setting. Thus, even though the presentation setting does not seem to modulate mu suppression during action observation, it does affect the anticipation-related mu suppression. We discuss the possibility that this may be due to increased social engagement in real-world settings, which in particular affects anticipation. The findings emphasise the importance of using real-world stimuli to bring out the subtle, anticipatory, aspects related to action observation.

Neural correlates of familiar and unfamiliar action in infancy

Behavioral evidence shows that experience with an action shapes action perception. Neural mirroring has been suggested as a mechanism underlying this behavioral phenomenon. Suppression of electroencephalogram (EEG) power in the mu frequency band, an index of motor activation, typically reflects neural mirroring. However, contradictory findings exist regarding the association between mu suppression and motor familiarity in infant EEG studies. In this study, we investigated the neural underpinnings reflecting the role of familiarity in action perception. We measured neural processing of familiar (grasp) and novel (tool-use) actions in 9- and 12-month-old infants. Specifically, we measured infants' distinct motor/visual activity and explored functional connectivity associated with these processes. Mu suppression was stronger for grasping than for tool use, whereas significant mu and occipital alpha (indexing visual activity) suppression were evident for both actions. Interestingly, selective motor-visual functional connectivity was found during observation of familiar action, a pattern not observed for novel action. Thus, the neural correlates of perception of familiar actions may be best understood in terms of a functional neural network rather than isolated regional activity. Our findings provide novel insights on analytic approaches for identifying motor-specific neural activity while also considering neural networks involved in observing motorically familiar versus unfamiliar actions.

Mirroring Communicative Actions: Contextual Modulation of Mu Rhythm Desynchronization in Response to the 'Back-Of-Hand' Action in 9-Month-Old Infants

This study measured mu rhythm desynchronization (MRD), while nine-month-old infants observed an agent extend her arm and hand, palm up ('back-of-hand action') either in social (object and recipient present), individual (object present, recipient absent), or social object-absent (recipient present, object absent) situations across two experiments. In addition, infants' MRD was measured as they reached for objects. Results revealed significant mu desynchronization in the right centro-parietal region selectively for the social group, indicating that infants processed the back-of-hand action as an object-directed request. Findings suggest to extend the action reconstruction account to object-directed communicative actions as well.

Body-Space Interactions: Same Spatial Encoding but Different Influence of Valence for Reaching and Defensive Purposes

The space around our body, the so-called peripersonal space, is where interactions with nearby objects may occur. "Defensive space" and "Reaching space", respectively, refer to two opposite poles of interaction between our body and the external environment: protecting the body and performing a goal-directed action. Here, we hypothesized that mechanisms underlying these two action spaces are differentially modulated by the valence of visual stimuli, as stimuli with negative valence are more likely to activate protective actions whereas stimuli with positive valence may activate approaching actions. To test whether such distinction in cognitive/evaluative processing exists between Reaching and Defensive spaces, we measured behavioral responses as well as neural activations over sensorimotor cortex using EEG while participants performed several tasks designed to tap into mechanisms underlying either Defensive (e.g., respond to touch) or Reaching space (e.g., estimate whether object is within reaching distance). During each task, pictures of objects with either positive or negative valence were presented at different distances from the participants' body. We found that Defensive space was smaller for positively compared with negatively valenced visual stimuli. Furthermore, sensorimotor cortex activation (reflected in modulation of beta power) during tactile processing was enhanced when coupled with negatively rather than positively valenced visual stimuli regarding Defensive space. On the contrary, both the EEG and behavioral measures capturing the mechanisms underlying Reaching space did not reveal any modulation by valence. Thus, although valence encoding had differential effects on Reaching and Defensive spaces, the distance of the visual stimulus modulated behavioral measures as well as activity over sensorimotor cortex (reflected in modulations of mu power) in a similar way for both types of spaces. Our results are compatible with the idea that Reaching and Defensive spaces involve the same distance-dependent neural representations of sensory input, whereas task goals and stimulus valence (i.e., contextual information) are implemented at a later processing stage and exert an influence on motor output rather than sensory/space encoding.

The Effect of Baseline on Toddler Event-Related Mu-Rhythm Modulation

Event-related mu-rhythm activity has become a common tool for the investigation of different socio-cognitive processes in pediatric populations. The estimation of the mu-rhythm desynchronization/synchronization (mu-ERD/ERS) in a specific task is usually computed in relation to a baseline condition. In the present study, we investigated the effect that different types of baseline might have on toddler mu-ERD/ERS related to an action observation (AO) and action execution (AE) task. Specifically, we compared mu-ERD/ERS values computed using as a baseline: (1) the observation of a static image (BL1) and (2) a period of stillness (BL2). Our results showed that the majority of the subjects suppressed the mu-rhythm in response to the task and presented a greater mu-ERD for one of the two baselines. In some cases, one of the two baselines was not even able to produce a significant mu-ERD, and the preferred baseline varied among subjects even if most of them were more sensitive to the BL1, thus suggesting that this could be a good baseline to elicit mu-rhythm modulations in toddlers. These results recommended some considerations for the design and analysis of mu-rhythm studies involving pediatric subjects: in particular, the importance of verifying the mu-rhythm activity during baseline, the relevance of single-subject analysis, the possibility of including more than one baseline condition, and caution in the choice of the baseline and in the interpretation of the results of studies investigating mu-rhythm activity in pediatric populations.

Social context shapes neural processing of others' actions in 9-month-old infants

From infancy, neural processes for perceiving others' actions and producing one's own actions overlap (neural mirroring). Adults and children show enhanced mirroring in social interactions. Yet, whether social context affects mirroring in infancy, a time when processing others' actions is crucial for action learning, remains unclear. We examined whether turn-taking, an early form of social interaction, enhanced 9-month-olds' neural mirroring. We recorded electroencephalography while 9-month-olds were grasping (execution) and observing live grasps (observation). In this design, half of the infants observed and acted in alternation (turn-taking condition), whereas the other half observed several times in a row before acting (blocked condition). Replicating previous findings, infants showed significant 6- to 9-Hz mu suppression (indicating motor activation) during execution and observation (n = 24). In addition, a condition (turn-taking or blocked) by time (action start or end) interaction indicated that infants engaged in turn-taking (n = 9), but not in the blocked context (n = 15), showed more mirroring when observing the action start compared with the action end. Exploratory analyses further suggest that (a) there is higher visual-motor functional connectivity in turn-taking toward the action's end, (b) mirroring relates to later visual-motor connectivity, and (c) visual attention as indexed by occipital alpha is enhanced in turn-taking compared with the blocked context. Together, this suggests that the neural processing of others' actions is modulated by the social context in infancy and that turn-taking may be particularly effective in engaging infants' action perception system.

Age-related Differences in Mu rhythm during Emotional Destination Memory

BACKGROUND

Destination memory, defined as the ability to remember to whom we addressed a piece of information, is found to be impaired in normal aging. Theories on development of affect and research findings have shown that emotional charge improves performance in memory tasks, and also that Mu rhythm is desynchronized as an index of mirror neuron activation during such tasks.

OBJECTIVE

In this paper, we sought to investigate the differences in Mu rhythm during an emotional destination memory task between younger and older adults.

METHODS

16 cognitively normal older adults, recruited from Alzheimer's disease day center and 16 young adults, recruited via advertisements, participated in this experimental study. We investigated the destination memory of emotionally charged faces (Emotional Destination Memory, EDM) while applying electroencephalograph (EEG) in real-time in young versus older adults. We measured Mu rhythm in frontal, fronto-temporal and central areas. EEG data has been pre-processed, segmented in non-overlapping epochs, and independent component analysis (ICA) has been conducted to reject artifacts.

RESULTS

Results showed that young adults performed better than older adults in remembering facts associated with angry faces. Also, a difference in neurophysiological activation was found, with older adults showing Mu suppression in frontal and fronto-temporal regions, specifically in F3, F7 and F8 electrodes, in contrast with young adults who showed Mu enhancement. With regard to the within-group differences, it was found that in the older adults group, electrodes F8 and central C3 were the most activated, while in the young adults group, C3 was the most activated electrode.

CONCLUSION

The findings suggest better behavioral performance of young adults as a result of a better cognitive state and adaptive bias. On a neurophysiological level, it is suggested that older adults employ Mu suppression, thus activation of mirror neurons is a possible compensatory mechanism while mirroring properties are not spontaneously activated in young adults.

Does agency matter? Neural processing of robotic movements in 4- and 8-year olds

Despite the increase in interactions between children and robots, our understanding of children's neural processing of robotic movements is limited. The current study theorized that motor resonance hinges on the agency of an actor: its ability to perform actions volitionally. As one of the first studies with a cross-sectional sample of preschoolers and older children and with a specific focus on robotic action (rather than abstract non-human action), the current study investigated whether the perceived agency of a robot moderated children's motor resonance for robotic movements, and whether this changed with age. Motor resonance was measured using electroencephalography (EEG) by assessing mu power while 4 and 8-year-olds observed actions performed by agentic versus non-agentic robots and humans. Results show that older children resonated more strongly with non-agentic than agentic robotic or human movement, while no such differences were found for preschoolers. This outcome is discussed in terms of a predictive coding account of motor resonance. Importantly, these findings contribute to the existing set of studies on this topic by showing that, while keeping all kinematic information constant, there is a clear developmental difference in how children process robotic movement depending on the level of agency of a robot.

Importance of body representations in social-cognitive development: New insights from infant brain science

There is significant interest in the ways the human body, both one's own and that of others, is represented in the human brain. In this chapter we focus on body representations in infancy and synthesize relevant findings from both infant cognitive neuroscience and behavioral experiments. We review six experiments in infant neuroscience that have used novel EEG and MEG methods to explore infant neural body maps. We then consider results from behavioral studies of social imitation and examine what they contribute to our understanding of infant body representations at a psychological level. Finally, we interweave both neuroscience and behavioral lines of research to ground new theoretical claims about early infant social cognition. We propose, based on the evidence, that young infants can represent the bodily acts of others and their own bodily acts in commensurate terms. Infants initially recognize correspondences between self and other-they perceive that others are "like me" in terms of bodies and bodily actions. This capacity for registering and using self-other equivalence mappings has far-reaching implications for mechanisms of developmental change. Infants can learn about the affordances and powers of their own body by watching adults' actions and their causal consequences. Reciprocally, infants can enrich their understanding of other people's internal states by taking into account the way they themselves feel when they perform similar acts. The faces, bodies, and matching actions of people are imbued with unique meaning because they can be mapped to the infant's own body and behavior.

The Pattern of Mu Rhythm Modulation During Emotional Destination Memory: Comparison Between Mild Cognitive Impairment Patients and Healthy Controls

Leading theories of affect development and empirical studies suggest that emotion can enhance memory in older adults. Destination memory which is defined as the ability to remember to whom we told a piece of information is being found to be compromised in aging. In the present study, we sought to assess destination memory using emotional stimuli (Emotional Destination Memory, EDM) in 16 older adults with mild cognitive impairment (MCI) and 16 healthy controls and shed light onto its potential neurophysiological aspects. We measured Mu suppression in frontal and temporal regions via EEG in real time while participants performed the task of EDM. Results showed no group differences in task performance but significant differences in fronto-temporal activations, specifically in electrodes F7 and F8. Differential Mu rhythm pattern was observed between healthy controls and MCI with the first exhibiting Mu suppression and the last Mu enhancement. Furthermore, Mu enhancement in temporal electrodes within the MCI group was associated with lower scores on EDM. The absence of group differences in the task can be explained by the fact that even if there are underlying structural or functional deficits in the MCI group, these deficits are manifested only at neurophysiological level and not at a behavioral level, which is a common pattern in the process of cognitive decline in its initial phases. The overall findings reveal that, even if there are not any behavioral decrements in MCI patients, they show reduced activations in fronto-temporal regions and this can be attributed to general impairment in emotional destination memory due to possible mirror neuron deficiency.

The Post-Movement Beta Rebound and Motor-Related Mu Suppression in Children

Age-related EEG activity change is a prominent feature that reflects the functional development of the brain. The current study investigated the beta and mu rhythms of 16 children (7.7 ± 1.5 years, 5 to 9.6 years) and 13 adults when a self-determining arm motion was performed. The results indicated that mu power was decreased during movement and returned to baseline level after the movement for both children and adults. However, although a decrease in beta power was observed for both children and adults during movement, the post-movement beta power rebound (PMBR) was observed in adults but not in children. These results suggest that motor-related mu suppression develops early in children; PMBR develops later and may be associated with a more prolonged motor development process.

Observation of the point-light animation of a grasping hand activates sensorimotor cortex in nine-month-old infants

Measuring changes in sensorimotor alpha band activity in nine-month-old infants we sought to understand the involvement of the sensorimotor cortex during observation of the Point-Light (PL) animation of a grasping hand. Attenuation of alpha activity was found both when the PL display moved towards the to-be-grasped object and when the object was deleted from the video. Before the beginning of the movement of the PL stimuli, only in the presence of the object evoked attenuation of sensorimotor alpha activity was documented, possibly interpreted either as movement prediction or as graspable object perception. Our main findings demonstrate that, during observation of stimuli moving with biological kinematics, the infants' sensorimotor system is activated when the pictorial information is absent or highly reduced, and independently of the presence of the goal-directed object. The possible compensatory function of the sensorimotor system during observation of highly degraded moving stimuli is discussed.

Exploring the EEG mu rhythm associated with observation and execution of a goal-directed action in 14-month-old preterm infants

Electroencephalographic mu rhythm desynchronization is thought to reflect Mirror Neuron System (MNS) activity and represents an important neural correlate of the coupling between action execution and perception. It is still unclear if the MNS in human ontogeny is already available at the beginning of postnatal life and how early experience impacts its development. Premature birth provides a "natural condition" for investigating the effects of early, atypical extra-uterine experience on MNS. The main aim of the present study was to investigate whether the MNS activity is associated with prematurity. We compared the mu rhythm activity in preterm (PT) and full-term (FT) 14-month old infants during an action observation/execution (AO/AE) task. Mu rhythm desynchronization was computed over frontal, central, parietal and occipital regions. Both groups showed mu rhythm suppression in all the scalp regions during action execution. Different desynchronization patterns emerged during action observation. Specifically, FT infants showed mu suppression in the right frontal, bilateral parietal and occipital regions; whereas PT infants exhibited mu suppression only in the right parietal region. Overall, these preliminary findings indicate that an atypical extra uterine experience might have an impact on the MNS activity.

Building blocks of joint attention: Early sensitivity to having one's own gaze followed

Detecting when one's own gaze has been followed is a critical component of joint attention, but little is known about its development. To address this issue, we used electroencephalography (EEG) to record infant neural responses at 6.5 and 9.5 months during observation of an adult either turning to look at the same object as the infant (congruent actor), or turning to look at a different object (incongruent actor). We also used a preferential looking paradigm to investigate whether infants would demonstrate a preference for the congruent versus incongruent actor. Greater suppression of alpha band activity in the congruent compared to incongruent condition was revealed at both ages in central and parietal regions. However, the effect of congruency on alpha suppression was stronger at 9.5 months, and only at this age did infants demonstrate a preference towards looking at the congruent actor. Together, these results suggest that although infants are sensitive to others' gaze following from early on, important neural and behavioural developments occur between 6.5 and 9.5 months.

Distinct visuo-motor brain dynamics for real-world objects versus planar images

Ultimately, we aim to generalize and translate scientific knowledge to the real world, yet current understanding of human visual perception is based predominantly on studies of two-dimensional (2-D) images. Recent cognitive-behavioral evidence shows that real objects are processed differently to images, although the neural processes that underlie these differences are unknown. Because real objects (unlike images) afford actions, they may trigger stronger or more prolonged activation in neural populations for visuo-motor action planning. Here, we recorded electroencephalography (EEG) when human observers viewed real-world three-dimensional (3-D) objects or closely matched 2-D images of the same items. Although responses to real objects and images were similar overall, there were critical differences. Compared to images, viewing real objects triggered stronger and more sustained event-related desynchronization (ERD) in the μ frequency band (8-13 Hz) - a neural signature of automatic motor preparation. Event-related potentials (ERPs) revealed a transient, early occipital negativity for real objects (versus images), likely reflecting 3-D stereoscopic differences, and a late sustained parietal amplitude modulation consistent with an 'old-new' memory advantage for real objects over images. Together, these findings demonstrate that real-world objects trigger stronger and more sustained action-related brain responses than images do. The results highlight important similarities and differences between brain responses to images and richer, more ecologically relevant, real-world objects.

The neural basis for understanding imitation-induced musical meaning: The role of the human mirror system

Music can convey meanings by imitating phenomena of the extramusical world, and these imitation-induced musical meanings can be understood by listeners. Although the human mirror system (HMS) is implicated in imitation, little is known about the HMS's role in making sense of meaning that derives from musical imitation. To answer this question, we used fMRI to examine listeners' brain activities during the processing of imitation-induced musical meaning with a cross-modal semantic priming paradigm. Eleven normal individuals and 11 individuals with congenital amusia, a neurodevelopmental disorder of musical processing, participated in the experiment. Target pictures with either an upward or downward movement were primed by semantically congruent or incongruent melodic sequences characterized by the direction of pitch change (upward or downward). When contrasting the incongruent with the congruent condition between the two groups, we found greater activations in the left supramarginal gyrus/inferior parietal lobule and inferior frontal gyrus in normals but not in amusics. The implications of these findings in terms of the role of the HMS in understanding imitation-induced musical meaning are discussed.

The role of the motor system in action understanding and communication: Evidence from human infants and non-human primates

There is growing evidence that activation of the motor system during observation of actions, a phenomenon first observed in non-human primates, underlies action understanding and even communication. This review (a) examines the evidence on motor system activity as an underlying neural correlate of action understanding; (b) reviews the theoretical and empirical work linking action understanding and the development of communication, with a specific focus on the role that gestures play as an intermediary; and (c) discusses the research on and existing opportunities for understanding the link between the motor system and communication in both humans and non-human primates, through the lens of action perception. Bringing together findings and perspectives from developmental social cognition in both humans and non-human primates and applying recent neuroscientific perspectives will help to elucidate the processes underlying the ability to understand and communicate with others.

Mu rhythm desynchronization is specific to action execution and observation: Evidence from time-frequency and connectivity analysis

Mu desynchronization is the attenuation of EEG power in the alpha frequency range recorded over central scalp locations thought to reflect motor cortex activation. Mu desynchronization during observation of an action is believed to reflect mirroring system activation in humans. However, this notion has recently been questioned because, among other reasons, the potential contamination of mu rhythm and occipital alpha activity induced by attention processes following presentation of visual stimuli in observation conditions. This study examined the validity of mu desynchronization as a measure of mirroring system activation in infants and further investigated the pattern of functional connectivity between the central and occipital regions during execution and observation of movement. EEG was recorded while 46 9-month-old infants executed grasping actions and observed an experimenter grasping. Current source density (CSD) was applied to EEG data and, time-frequency and connectivity analyses were performed in CSD transformed data. Mu desynchronization was evident over central regions during both execution and observation of movements. Independent alpha desynchronization over occipital region was also present in both conditions. The connectivity analyses revealed that central-occipital areas were functionally more connected compared to other areas of the brain during observation of movements. Collectively, the results demonstrate the validity of mu desynchronization as an index of infant mirroring system activity and support the proposal of a functional connection between distinct mirroring and attention processes during observation of action.

The Development of Sensorimotor Intelligence in Infants

Infancy is the most dynamic part of human development. During this period, all basic sensorimotor and cognitive abilities are established. In this chapter, we will trace some of the important achievements of this development with a focus on how infants achieve predictive control of actions, i.e., how they come to coordinate their behavior with the ongoing events in the world without lagging behind. With the maturation of the brain, new possibilities that have profound effects on cognition open up. Some of them are core abilities, i.e., they function at birth or very early in development. Important examples are the structured perception of objects and surfaces and the control of arm movements. Closely after birth, infants move their arms to the vicinity of objects in front of them demonstrating that they have some control of their arms and indicating that they perceive objects as such. Another example is the rapid onset of smooth-pursuit eye movements during the second month of life and the emerging ability to predict when and where an occluded moving object will reappear. At 4months of age, out of sight is no longer of mind. The child's sensorimotor system is especially designed to facilitate the extraction of knowledge about the world including other people. In addition, the infant is endowed with motives that ensure that the innate predispositions are transformed into a system of knowledge for guiding actions predictively. By perceiving and acting on the world, infants develop their cognition and through developmental studies; we can learn more about these processes.

Understanding Activation Patterns in Shared Circuits: Toward a Value Driven Model

Over the past decade many studies indicate that we utilize our own motor system to understand the actions of other people. This mirror neuron system (MNS) has been proposed to be involved in social cognition and motor learning. However, conflicting findings regarding the underlying mechanisms that drive these shared circuits make it difficult to decipher a common model of their function. Here we propose adapting a “value-driven” model to explain discrepancies in the human mirror system literature and to incorporate this model with existing models. We will use this model to explain discrepant activation patterns in multiple shared circuits in the human data, such that a unified model may explain reported activation patterns from previous studies as a function of value.

EEG beta desynchronization during hand goal-directed action observation in newborn monkeys and its relation to the emergence of hand motor skills

Previous developmental research suggests that motor experience supports the development of action perception across the lifespan. However, it is still unknown when the neural mechanisms underlying action-perception coupling emerge in infancy. The goal of this study was to examine the neural correlates of action perception during the emergence of grasping abilities in newborn rhesus macaques. Neural activity, recorded via electroencephalogram (EEG), while monkeys observed grasping actions, mimed actions and means-end movements during the first (W1) and second week (W2) of life was measured. Event-related desynchronization (ERD) during action observation was computed from the EEG in the alpha and beta bands, two components of the sensorimotor mu rhythm associated with activity of the mirror neuron system (MNS). Results revealed age-related changes in the beta band, but not the alpha band, over anterior electrodes, with greater desynchronization at W2 than W1 for the observation of grasping actions. Additionally, desynchronization to observed grasping actions at W2 was associated with infants’ motor skills – measured by a separate behavioral task – such that more grasping attempts were associated to greater beta ERD. These findings suggest the emergence of an early action-perception system, that relies on motor experience, shortly after birth.

Hand-Eye Coordination Predicts Joint Attention

The present article shows that infant and dyad differences in hand-eye coordination predict dyad differences in joint attention (JA). In the study reported here, 51 toddlers ranging in age from 11 to 24 months and their parents wore head-mounted eye trackers as they played with objects together. We found that physically active toddlers aligned their looking behavior with their parent and achieved a substantial proportion of time spent jointly attending to the same object. However, JA did not arise through gaze following but rather through the coordination of gaze with manual actions on objects as both infants and parents attended to their partner's object manipulations. Moreover, dyad differences in JA were associated with dyad differences in hand following.

Interacting With Robots to Investigate the Bases of Social Interaction

Humans show a great natural ability at interacting with each other. Such efficiency in joint actions depends on a synergy between planned collaboration and emergent coordination, a subconscious mechanism based on a tight link between action execution and perception. This link supports phenomena as mutual adaptation, synchronization, and anticipation, which cut drastically the delays in the interaction and the need of complex verbal instructions and result in the establishment of joint intentions, the backbone of social interaction. From a neurophysiological perspective, this is possible, because the same neural system supporting action execution is responsible of the understanding and the anticipation of the observed action of others. Defining which human motion features allow for such emergent coordination with another agent would be crucial to establish more natural and efficient interaction paradigms with artificial devices, ranging from assistive and rehabilitative technology to companion robots. However, investigating the behavioral and neural mechanisms supporting natural interaction poses substantial problems. In particular, the unconscious processes at the basis of emergent coordination (e.g., unintentional movements or gazing) are very difficult-if not impossible-to restrain or control in a quantitative way for a human agent. Moreover, during an interaction, participants influence each other continuously in a complex way, resulting in behaviors that go beyond experimental control. In this paper, we propose robotics technology as a potential solution to this methodological problem. Robots indeed can establish an interaction with a human partner, contingently reacting to his actions without losing the controllability of the experiment or the naturalness of the interactive scenario. A robot could represent an "interactive probe" to assess the sensory and motor mechanisms underlying human-human interaction. We discuss this proposal with examples from our research with the humanoid robot iCub, showing how an interactive humanoid robot could be a key tool to serve the investigation of the psychological and neuroscientific bases of social interaction.

Aproximación Neurodinámica a la Cognición Social

En las últimas décadas ha crecido el estudio los mecanismos involucrados en el comportamiento social, gran parte de estas indagaciones se han realizado desde una aproximación de la neurociencia social cognitiva, la cual se basa en un modelo representacional del procesamiento de información. No obstante, esta aproximación ha sido ampliamente criticada por desconocer la participación del cuerpo, la dinámica afectiva, el contexto social, el cambio durante el desarrollo y suponer un procesamiento modular endógeno. En este sentido, este artículo presenta un modelo neurodinámico de la cognición social, comprendiéndola desde una aproximación enactiva, situada, relacional y sistémica. Desde este modelo se describen los principales cambios en esperados la actividad cerebral durante las interacciones sociales en tiempo real y durante la ontogenia. Se concluye resaltando los desafíos y oportunidades que este tipo de aproximaciones puede proporcionar a la neurociencia y psicología social del futuro.

Mu desynchronization during observation and execution of facial expressions in 30-month-old children

Simulation theories propose that observing another's facial expression activates sensorimotor representations involved in the execution of that expression, facilitating recognition processes. The mirror neuron system (MNS) is a potential mechanism underlying simulation of facial expressions, with like neural processes activated both during observation and performance. Research with monkeys and adult humans supports this proposal, but so far there have been no investigations of facial MNS activity early in human development. The current study used electroencephalography (EEG) to explore mu rhythm desynchronization, an index of MNS activity, in 30-month-old children as they observed videos of dynamic emotional and non-emotional facial expressions, as well as scrambled versions of the same videos. We found significant mu desynchronization in central regions during observation and execution of both emotional and non-emotional facial expressions, which was right-lateralized for emotional and bilateral for non-emotional expressions during observation. These findings support previous research suggesting movement simulation during observation of facial expressions, and are the first to provide evidence for sensorimotor activation during observation of facial expressions, consistent with a functioning facial MNS at an early stage of human development.

Action observation in infancy: implications for neuro-rehabilitation

Action observation therapy has been found to be effective in improving hand motor function in both adults with stroke and children with unilateral cerebral palsy. We here propose a provocative hypothesis arguing that the same therapy might be effective in very early intervention in infants with unilateral or asymmetric brain damage, but through a different underlying mechanism. If the activation of motor networks induced in infancy by action observation enhances the excitability of the damaged sensorimotor cortex, it could also accelerate the maturation of the corticospinal tract and the adaptive shaping of the spinal motor circuits. This hypothesis should be explored carefully in prospective studies and, if confirmed, might support the use of action observation therapy at a much earlier time than experimented so far.

Enhanced Neural Processing of Goal-directed Actions After Active Training in 4-Month-Old Infants

The current study explores the neural correlates of action perception and its relation to infants' active experience performing goal-directed actions. Study 1 provided active training with sticky mittens that enables grasping and object manipulation in prereaching 4-month-olds. After training, EEG was recorded while infants observed images of hands grasping toward (congruent) or away from (incongruent) objects. We demonstrate that brief active training facilitates social perception as indexed by larger amplitude of the P400 ERP component to congruent compared with incongruent trials. Study 2 presented 4-month-old infants with passive training in which they observed an experimenter perform goal-directed reaching actions, followed by an identical ERP session to that used in Study 1. The second study did not demonstrate any differentiation between congruent and incongruent trials. These results suggest that (1) active experience alters the brains' response to goal-directed actions performed by others and (2) visual exposure alone is not sufficient in developing the neural networks subserving goal processing during action observation in infancy.

Quantifying Motor Experience in the Infant Brain: EEG Power, Coherence, and Mu Desynchronization

The emergence of new motor skills, such as reaching and walking, dramatically changes how infants engage with the world socially and cognitively. Several examples of how motor experience can cascade into cognitive and social development have been documented, yet a significant knowledge gap remains in our understanding of whether these observed behavioral changes are accompanied by underlying neural changes. We propose that electroencephalography (EEG) measures such as power, coherence, and mu desynchronization are optimal tools to quantify motor experience in the infant brain. In this mini-review, we will summarize existing infant research that has separately assessed the relation between motor, cognitive, or social development with coherence, power, or mu desynchronization. We will discuss how the reviewed neural changes seen in seemingly separate developmental domains may be linked based on existing behavioral evidence. We will further propose that power, coherence, and mu desynchronization be used in research exploring the links between motor experience and cognitive and social development.

Spectral and source structural development of mu and alpha rhythms from infancy through adulthood

OBJECTIVE

To assess the developmental trajectory of spectral, topographic, and source structural properties of functional mu desynchronization (characterized during voluntary reaching/grasping movement), and investigate its spectral/topographic relation to spontaneous EEG in the developing alpha band.

METHODS

Event related desynchronization (ERD) and power spectral density spectra/topography are analyzed in 12 month-old infants, 4 year-old children, and adults. Age-matched head models derived from structural MRI are used to obtain current density reconstructions of mu desynchronization across the cortical surface.

RESULTS

Infant/child EEG contains spectral peaks evident in both the upper and lower developing alpha band, and spectral/topographic properties of functionally identified mu rhythm strongly reflect those of upper alpha in all subject groups. Source reconstructions show distributed frontoparietal patterns of cortical mu desynchronization concentrated in specific central and parietal regions which are consistent across age groups.

CONCLUSIONS

Peak frequencies of mu desynchronization and spontaneous alpha band EEG increase with age, and characteristic mu topography/source-structure is evident in development at least as early as 12 months.

SIGNIFICANCE

Results provide evidence for a cortically distributed functional mu network, with spontaneous activity measurable in the upper alpha band throughout development.

Relations between infants' emerging reach-grasp competence and event-related desynchronization in EEG

Recent reports of similar patterns of brain electrical activity (electroencephalogram: EEG) during action execution and observation, recorded from scalp locations over motor-related regions in infants and adults, have raised the possibility that two foundational abilities--controlling one's own intentional actions and perceiving others' actions--may be integrally related during ontogeny. However, to our knowledge, there are no published reports of the relations between developments in motor skill (i.e. recording actual motor skill performance) and EEG during both action execution and action observation. In the present study we collected EEG from 21 9-month-olds who were given opportunities to reach for toys and who also observed an experimenter reach for toys. Event-related desynchronization (ERD) was computed from the EEG during the reaching events. We assessed infants' reaching-grasping competence, including reach latency, errors, preshaping of the hand, and bimanual reaches, and found that desynchronization recorded in scalp electrodes over motor-related regions during action observation was associated with action competence during execution. Infants who were more competent reachers, compared to less competent reachers, exhibited greater ERD while observing reaching-grasping. These results provide initial evidence for an early emerging neural system integrating one's own actions with the perception of others' actions.

Assessing human mirror activity with EEG mu rhythm: A meta-analysis

A fundamental issue in cognitive neuroscience is how the brain encodes others' actions and intentions. In recent years, a potential advance in our knowledge on this issue is the discovery of mirror neurons in the motor cortex of the nonhuman primate. These neurons fire to both execution and observation of specific types of actions. Researchers use this evidence to fuel investigations of a human mirror system, suggesting a common neural code for perceptual and motor processes. Among the methods used for inferring mirror system activity in humans are changes in a particular frequency band in the electroencephalogram (EEG) called the mu rhythm. Mu frequency appears to decrease in amplitude (reflecting cortical activity) during both action execution and action observation. The current meta-analysis reviewed 85 studies (1,707 participants) of mu that infer human mirror system activity. Results demonstrated significant effect sizes for mu during execution (Cohen's d = 0.46, N = 701) as well as observation of action (Cohen's d = 0.31, N = 1,508), confirming a mirroring property in the EEG. A number of moderators were examined to determine the specificity of these effects. We frame these meta-analytic findings within the current discussion about the development and functions of a human mirror system, and conclude that changes in EEG mu activity provide a valid means for the study of human neural mirroring. Suggestions for improving the experimental and methodological approaches in using mu to study the human mirror system are offered.

Neural mechanisms of the observation of human and non-human object touch in children: An event-related potential study

Previous behavioural research on the development of self-other tactile processing and perception suggests that this system may develop in a somewhat protracted manner relative to other aspects of social development. Neuroimaging research has shown that somatosensory mechanisms are activated when adults observe another person or object being touched. In this study, we measured event-related potentials from 4- to 5-year-old children to investigate the development of the neural correlates of the observation of human and object touch. Participants were presented with video clips of an arm or a cylindrical object being touched. Touch versus non-touch effects were observed in the amplitudes of the LSW component (600-700 ms) measured from electrodes over somatosensory region. Additionally, human versus non-human stimulus effects were reflected in the amplitudes of the parietal-central N100 component, as well as in the latencies of the N170 component recorded from parietal-occipital electrodes in children, as in adults in a previous study using this same paradigm. These findings provide evidence that relatively mature tactile mirroring mechanisms are activated during the observation of touch in children, and further suggest the possibility that these mechanisms are not particularly slow in their development relative to other aspects of social cognition.

Action observation network in childhood: a comparative fMRI study with adults

Very little is known about the action observation network and the mirror neuron system (AON/MNS) in children and its age-related properties compared with those observed in adults. In the present fMRI study we explored the activation of areas belonging to the AON/MNS in children and adults during observation of complex hand-grasping actions, as compared to observation of simple grasping acts executed with the left and the right hand, seen from a first person perspective. The results indicate that during the action observation tasks in children there was activation of a cortical network similar to that found in adults, including the premotor cortex, the posterior part of the inferior frontal gyrus and the posterior parietal lobe. However, the activation in children was more widespread and showed a higher inter-subject variability compared with adults. Furthermore, the activated network seems more lateralized to the left hemisphere in adults and more bilateral in children, with a linear growth of lateralization index as a function of age. Finally, in children the activation in the anterior intraparietal cortex (AIP) of each hemisphere was higher during observation of the contralateral hand (hand identity effect) and during the observation of complex actions relative to simple grasping acts, confirming the role of AIP for action-related hand identity previously described in adults. These results support the assumption that structure and size of action representations are sensitive to mechanisms of development and show physiological plasticity. These properties of the AON/MNS could constitute a powerful tool for spontaneous reorganization and recovery of motor deficits after brain injury in children and in adults, as well as for specific rehabilitation programmes.

EEG μ rhythm in virtual reality reveals that motor coding of visual objects in peripersonal space is task dependent

Previous fMRI studies have shown that the visual perception of manipulable objects spontaneously involves the sensorimotor system, especially when the objects are located in peripersonal space. However, it has also been suggested that the motor coding of manipulable objects perceived in peripersonal space depends on an anticipation to interact with them. The present study aims at clarifying this issue by analyzing healthy adults' EEG activity on the centro-parietal region while perceptually judging intrinsic (prototypical or distorted shape) or extrinsic (reachable or not reachable location) properties of visual objects. In both the object identification and reachability judgment tasks, time-frequency decomposition of EEG signals was performed across the first 1000 ms following object presentation for trials on which no post-stimulus response was required (90% of the trials). Event-Related-(De)Synchronization (ERD/S) of μ rhythm was computed using the 150 ms pre-stimulus period as baseline. In the reachability judgment task, EEG analysis showed a desynchronization of μ rhythm starting 300 ms after object presentation, but only when the objects were presented with a prototypical shape in peripersonal space. For those objects, desynchronization of μ rhythm diminished progressively from peripersonal to extrapersonal space. By contrast, no such gradient was observed in the object identification task. On the whole, these data indicate that motor coding of visual objects expressed in the μ rhythm depends on an object's shape and location in space, but also on the goal of the perceptual task.

Good is up-spatial metaphors in action observation

Positive objects or actions are associated with physical highness, whereas negative objects or actions are related to physical lowness. Previous research suggests that metaphorical connection (“good is up” or “bad is down”) between spatial experience and evaluation of objects is grounded in actual experience with the body. Prior studies investigated effects of spatial metaphors with respect to verticality of either static objects or self-performed actions. By presenting videos of object placements, the current three experiments combined vertically-located stimuli with observation of vertically-directed actions. As expected, participants’ ratings of emotionally-neutral objects were systematically influenced by the observed vertical positioning, that is, ratings were more positive for objects that were observed being placed up as compared to down. Moreover, effects were slightly more pronounced for “bad is down,” because only the observed downward, but not the upward, action led to different ratings as compared to a medium-positioned action. Last, some ratings were even affected by observing only the upward/downward action, without seeing the final vertical placement of the object. Thus, both, a combination of observing a vertically-directed action and seeing a vertically-located object, and observing a vertically-directed action alone, affected participants’ evaluation of emotional valence of the involved object. The present findings expand the relevance of spatial metaphors to action observation, thereby giving new impetus to embodied-cognition research.

An EEG study on the somatotopic organisation of sensorimotor cortex activation during action execution and observation in infancy

Previous studies have shown that sensorimotor cortex activation is somatotopically-organised during action execution and observation in adulthood. Here we aimed to investigate the development of this phenomenon in infancy. We elicited arm and leg actions from 12-month-old infants and presented them, and a control group of adults, with videos of arm and leg actions while we measured their sensorimotor alpha suppression using EEG. Sensorimotor alpha suppression during action execution was somatotopically organised in 12-month-old infants: there was more suppression over the arm areas when infants performed reaching actions, and more suppression over the leg area when they performed kicking actions. Adults also showed somatotopically-organised activation during the observation of reaching and kicking actions. In contrast, infants did not show somatotopically-organised activation during action observation, but instead activated the arm areas when observing both reaching and kicking actions. We suggest that the somatotopic organisation of sensorimotor cortex activation during action observation may depend on infants' understanding of the action goal and their expectations about how this goal will be achieved.

Dissociating associative and motor aspects of action understanding: Processing of dual-ended tools by 16-month-old infants

When learning about the functions of novel tools, it is possible that infants may use associative and motoric processes. This study investigated the ability of 16-month-olds to associate the orientation in which an actor held a dual-function tool with the actor's prior demonstrated interest in one of two target objects, and their use of the tool on that target. The actors' hand posture did not differ between conditions. The infants were shown stimuli in which two actors acted upon novel objects with a novel tool, each actor employing a different function of the tool. Using an eye-tracker, infants' looking time at images depicting the actors holding the tool in an orientation congruent or incongruent with the actor's goal was measured. Infants preferred to look at the specific part of the tool that was incongruent with the actor's goal. Results show that the association formed involves the specific part of the tool, the actor, and the object the actor acted upon, but not the orientation of the tool. The capacity to form such associations is demonstrated in this study in the absence of motor information that would allow 16-month-olds to generate a specific representation of how the tool should be held for each action via mirroring processes.