Visual-proprioceptive intermodal perception using point light displays

Cortical signatures of visual body representation develop in human infancy

Human infants cannot report their experiences, limiting what we can learn about their bodily awareness. However, visual cortical responses to the body, linked to visual awareness and selective attention in adults, can be easily measured in infants and provide a promising marker of bodily awareness in early life. We presented 4- and 8-month-old infants with a flickering (7.5 Hz) video of a hand being stroked and recorded steady-state visual evoked potentials (SSVEPs). In half of the trials, the infants also received tactile stroking synchronously with visual stroking. The 8-month-old, but not the 4-month-old infants, showed a significant enhancement of SSVEP responses when they received tactile stimulation concurrent with the visually observed stroking. Follow-up experiments showed that this enhancement did not occur when the visual hand was presented in an incompatible posture with the infant's own body or when the visual stimulus was a body-irrelevant video. Our findings provide a novel insight into the development of bodily self-awareness in the first year of life.

Infants' identification of gender in biological motion displays

Infants' knowledge of social categories, including gender-typed characteristics, is a vital aspect of social cognitive development. In the current study, we examined 9- to 12-month-old infants' understanding of the categories "male" and "female" by testing for gender matching in voices or faces with biological motion depicted in point light displays (PLDs). Infants did not show voice-PLD gender matching spontaneously (Experiment 1) or after "training" with gender-matching voice-PLD pairs (Experiment 2). In Experiment 3, however, infants were trained with gender-matching face-PLD pairs and we found that patterns of visual attention to top regions of PLD stimuli during training predicted gender matching of female faces and PLDs. Prior to the end of the first postnatal year, therefore, infants may begin to identify gender in human walk motions, and perhaps form social categories from biological motion.

Observation of the point-light animation of a grasping hand activates sensorimotor cortex in nine-month-old infants

Measuring changes in sensorimotor alpha band activity in nine-month-old infants we sought to understand the involvement of the sensorimotor cortex during observation of the Point-Light (PL) animation of a grasping hand. Attenuation of alpha activity was found both when the PL display moved towards the to-be-grasped object and when the object was deleted from the video. Before the beginning of the movement of the PL stimuli, only in the presence of the object evoked attenuation of sensorimotor alpha activity was documented, possibly interpreted either as movement prediction or as graspable object perception. Our main findings demonstrate that, during observation of stimuli moving with biological kinematics, the infants' sensorimotor system is activated when the pictorial information is absent or highly reduced, and independently of the presence of the goal-directed object. The possible compensatory function of the sensorimotor system during observation of highly degraded moving stimuli is discussed.

Infant perception of sex differences in biological motion displays

We examined mechanisms underlying infants' ability to categorize human biological motion stimuli from sex-typed walk motions, focusing on how visual attention to dynamic information in point-light displays (PLDs) contributes to infants' social category formation. We tested for categorization of PLDs produced by women and men by habituating infants to a series of female or male walk motions and then recording posthabituation preferences for new PLDs from the familiar or novel category (Experiment 1). We also tested for intrinsic preferences for female or male walk motions (Experiment 2). We found that infant boys were better able to categorize PLDs than were girls and that male PLDs were preferred overall. Neither of these effects was found to change with development across the observed age range (∼4-18 months). We conclude that infants' categorization of walk motions in PLDs is constrained by intrinsic preferences for higher motion speeds and higher spans of motion and, relatedly, by differences in walk motions produced by men and women.

Tactile input and empathy modulate the perception of ambiguous biological motion

Evidence has shown that task-irrelevant auditory cues can bias perceptual decisions regarding directional information associated with biological motion, as indicated in perceptual tasks using point-light walkers (PLWs) (Brooks et al., 2007). In the current study, we extended the investigation of cross-modal influences to the tactile domain by asking how tactile input resolves perceptual ambiguity in visual apparent motion, and how empathy plays a role in this cross-modal interaction. In Experiment 1, we simulated the tactile feedback on the observers' fingertips when the (upright or inverted) PLWs (comprised of either all red or all green dots) were walking (leftwards or rightwards). The temporal periods between tactile events and critical visual events (the PLW's feet hitting the ground) were manipulated so that the tap could lead, synchronize, or lag the visual foot-hitting-ground event. We found that the temporal structures between tactile (feedback) and visual (hitting) events systematically biases the directional perception for upright PLWs, making either leftwards or rightwards more dominant. However, this effect was absent for inverted PLWs. In Experiment 2, we examined how empathy modulates cross-modal capture. Instead of giving tactile feedback on participants' fingertips, we gave taps on their ankles and presented the PLWs with motion directions of approaching (facing toward observer)/receding (facing away from observer) to resemble normal walking postures. With the same temporal structure, we found that individuals with higher empathy were more subject to perceptual bias in the presence of tactile feedback. Taken together, our findings showed that task-irrelevant tactile input can resolve the otherwise ambiguous perception of the direction of biological motion, and this cross-modal bias was mediated by higher level social-cognitive factors, including empathy.

The effects of exposure to dynamic expressions of affect on 5-month-olds' memory

The purpose of this study was to examine the behavioral effects of adults' communicated affect on 5-month-olds' visual recognition memory. Five-month-olds were exposed to a dynamic and bimodal happy, angry, or neutral affective (face-voice) expression while familiarized to a novel geometric image. After familiarization to the geometric image and exposure to the affective expression, 5-month-olds received either a 5-min or 1-day retention interval. Following the 5-min retention interval, infants exposed to the happy affective expressions showed a reliable preference for a novel geometric image compared to the recently familiarized image. Infants exposed to the neutral or angry affective expression failed to show a reliable preference following a 5-min delay. Following the 1-day retention interval, however, infants exposed to the neutral expression showed a reliable preference for the novel geometric image. These results are the first to demonstrate that 5-month-olds' visual recognition memory is affected by the presentation of affective information at the time of encoding.

In (or outside of) your neck of the woods: laterality in spatial body representation

Beside language, space is to date the most widely recognized lateralized systems. For example, it has been shown that even mental representations of space and the spatial representation of abstract concepts display lateralized characteristics. For the most part, this body of literature describes space as distal or something outside of the observer or actor. What has been strangely absent in the literature on the whole and specifically in the spatial literature until recently is the most proximal space imaginable – the body. In this review, we will summarize three strands of literature showing laterality in body representations. First, evidence of hemispheric asymmetries in body space in health and, second in body space in disease will be examined. Third, studies pointing to differential contributions of the right and left hemisphere to illusory body (space) will be summarized. Together these studies show hemispheric asymmetries to be evident in body representations at the level of simple somatosensory and proprioceptive representations. We propose a novel working hypothesis, whereby neural systems dedicated to processing action-oriented information about one’s own body space may ontogenetically serve as a template for the perception of the external world.

The relation between mirror self-image reactions and imitation in 14- and 18-month-old infants

Previous research suggests that sensitivity to aspects of the self and others develop in tandem. We tested 14- and 18-month-olds' imitative abilities and mirror self-image reactions (i.e., testing behavior and passing the mark test). Results showed that 14-month-olds' imitation was closely related to the occurrence of testing behavior in front of the mirror, where they checked whether they could control the movements of the mirror image. Eighteen-month-olds, however, no longer showed this relation. Furthermore, in 18-month-olds, we found a high association between imitation and passing the mark test. These correlations suggest that infants' mirror self-image reactions and imitation share the ability to detect and produce visual-motor contingencies.

Young Infants Match Facial and Vocal Emotional Expressions of Other Infants

Research has demonstrated that infants recognize emotional expressions of adults in the first half-year of life. We extended this research to a new domain, infant perception of the expressions of other infants. In an intermodal matching procedure, 3.5- and 5-month-old infants heard a series of infant vocal expressions (positive and negative affect) along with side-by-side dynamic videos in which one infant conveyed positive facial affect and another infant conveyed negative facial affect. Results demonstrated that 5-month-olds matched the vocal expressions with the affectively congruent facial expressions, whereas 3.5-month-olds showed no evidence of matching. These findings indicate that by 5 months of age, infants detect, discriminate, and match the facial and vocal affective displays of other infants. Further, because the facial and vocal expressions were portrayed by different infants and shared no face-voice synchrony, temporal or intensity patterning, matching was likely based on detection of a more general affective valence common to the face and voice.

Bodily illusions in young children: developmental change in visual and proprioceptive contributions to perceived hand position

We examined the visual capture of perceived hand position in forty-five 5- to 7-year-olds and in fifteen young adults, using a mirror illusion task. In this task, participants see their left hand on both the left and right (by virtue of a mirror placed at the midline facing the left arm, and obscuring the right). The accuracy of participants’ reaching was measured when proprioceptive and visual cues to the location of the right arm were put into conflict (by placing the arms at different distances from the mirror), and also when only proprioceptive information was available (i.e., when the mirror was covered). Children in all age-groups (and adults) made reaching errors in the mirror condition in accordance with the visually-specified illusory starting position of their hand indicating a visual capture of perceived hand position. Data analysis indicated that visual capture increased substantially up until 6 years of age. These findings are interpreted with respect to the development of the visual guidance of action in early childhood.

Detection of visual-tactile contingency in the first year after birth

It is well documented that in the first year after birth, infants are able to identify self-performed actions. This ability has been regarded as the basis of conscious self-perception. However, it is not yet known whether infants are also sensitive to aspects of the self when they cannot control the sensory feedback by means of self-performed actions. Therefore, we investigated the contribution of visual-tactile contingency to self-perception in infants. In Experiment 1, 7- and 10-month-olds were presented with two video displays of lifelike baby doll legs. The infant's left leg was stroked contingently with only one of the video displays. The results showed that 7- and 10-month-olds looked significantly longer at the contingent display than at the non-contingent display. Experiment 2 was conducted to investigate the role of morphological characteristics in contingency detection. Ten-month-olds were presented with video displays of two neutral objects (i.e., oblong wooden blocks of approximately the same size as the doll legs) being stroked in the same way as in Experiment 1. No preference was found for either the contingent or the non-contingent display but our results confirm a significant decrease in looking time to the contingent display compared to Experiment 1. These results indicate that detection of visual-tactile contingency as one important aspect of self-perception is present very early in ontogeny. Furthermore, this ability appears to be limited to the perception of objects that strongly resemble the infant's body, suggesting an early sensitivity to the morphology of one's own body.

Infants' visual-proprioceptive intermodal perception with imperfect contingency information

Two experiments explored 5-month-old infants' recognition of self-movement in the context of imperfect contingencies between felt and seen movement. Previous work has shown that infants can discriminate a display of another child's movements from an on-line video display of their own movements, even when featural information is removed. These earlier findings were extended by demonstrating self versus other discrimination when the visual information for movement was an unrelated object (a fluorescent mobile) directly attached to the child's leg, thus producing imperfect spatial and temporal contingency information. In contrast, intermodal recognition failed when the mobile was indirectly attached to infants' legs, thus eliminating spatial contingencies altogether and further weakening temporal contingencies. Together, these studies reveal that even imperfect contingency information can drive intermodal perception, given appropriate levels of spatial and temporal contingency information.

Delayed Intermodal Contingency Affects Young Children's Recognition of Their Current Self

This study investigated whether 2-, 3-, and 4-year-olds use their video feedback as a reflection of their current state, even when their feedback was presented with a short temporal delay. In Experiment 1, the effects of 1- and 2-s delayed feedback were examined on an analog of the mark test. In the case of live and 1-s delayed feedback, 3-year-olds passed the test; however, they failed in the case of 2-s delayed feedback. Experiment 2 examined the effect of prior experience of delayed contingency and explorative behavior. The results showed a significant effect of prior experience. These results suggest that detection of visual-proprioceptive contingency contributes to recognition of visual feedback as one's current self.

Visually inexperienced chicks exhibit spontaneous preference for biological motion patterns

When only a small number of points of light attached to the torso and limbs of a moving organism are visible, the animation correctly conveys the animal's activity. Here we report that newly hatched chicks, reared and hatched in darkness, at their first exposure to point-light animation sequences, exhibit a spontaneous preference to approach biological motion patterns. Intriguingly, this predisposition is not specific for the motion of a hen, but extends to the pattern of motion of other vertebrates, even to that of a potential predator such as a cat. The predisposition seems to reflect the existence of a mechanism in the brain aimed at orienting the young animal towards objects that move semi-rigidly (as vertebrate animals do), thus facilitating learning, i.e., through imprinting, about their more specific features of motion.

Synaptic organization of monosynaptic connections from mesencephalic trigeminal nucleus neurons to hypoglossal motoneurons in the rat

Synaptological characteristics of synapses between axonal boutons of the trigeminal mesencephalic nucleus (Vme) neurons and the hypoglossal nucleus (XII) motoneurons (MNs) were studied using biotinylated dextran amine (BDA) anterograde labeling combined with horseradish peroxidase (HRP) retrograde transport in the rat. BDA was initially iontophoresed into Vme unilaterally and 7 days later HRP was injected into the anterior two-thirds of the ipsilateral tongue. After histochemical reactions, BDA anterogradely labeled boutons were seen to appose closely to somata and dendrites of HRP retrogradely labeled MNs in XII by light microscopy. A total of 212 BDA-labeled Vme boutons were examined ultrastructurally, which had an average diameter of 1.3 +/- 0.4 microm and contain small clear spherical vesicles. Eighty-eight percent of Vme boutons (187/212) synapsed on dendrites of HRP-labeled XII MNs. Twenty-five Vme boutons (25/212, 12%) made synapses with somata of HRP-labeled XII MNs. Thirty-five percent (74/212) of BDA-labeled Vme boutons were also contacted by unlabeled P-type terminals. Presynaptic P-type terminals contained spherical (47%, 35/74), pleomorphic (43%, 32/74), and flattened (10%, 7/74) synaptic vesicles. Thus, P-type terminals (as a presynaptic element), BDA-labeled Vme boutons, and XII MNs constitute axoaxodendritic and axoaxosomatic synaptic triads. There are four types of synaptic microcircuits in XII neuropil: synaptic convergence, synaptic divergence, presynaptic inhibition synaptic circuits, and feedforward regulation circuits. This detailed ultrastructure examination of the synaptic organization between Vme neurons and XII MNs provides insights into the synaptic mechanisms of the trigeminal proprioceptive afferents involved in the jaw-tongue reflex and coordination during oral motor behaviors.