Response preparation begins before mental rotation is finished: evidence from event-related brain potentials

The time course of planar and non-planar rotations in a letter rotation task

Mental rotation (MR) of character letters requires participants to mentally rotate the letter in their minds' eyes through a process akin to the physical rotation of the stimulus. It has been suggested that different cognitive processes are engaged during such MR of both canonical and mirror-reversed letters. In addition to the planar rotation of the canonical letters, an additional "flip-over" process (non-planar rotation) has been assumed during the MR of mirror-reversed letters. However, the temporal relationship between planar and non-planar rotation has not been systematically investigated. In this study, the occurrence of both planar and non-planar rotations were examined through the analysis of the event-related brain potentials (ERPs) elicited by canonical or mirror-reversed letters presented at different rotation angles between 300 and 1000 ms post-stimulus onset over consecutive 50ms time-windows. For smaller rotation angles (30° and 60°), non-planar rotation preceded planar rotation. For letters rotated by 90°, planar and non-planar rotation occurred at the same time. For larger angles (120° and 150°), the letter was first rotated within the plane (planar rotation) and afterwards it was also rotated out-of-the-plane (non-planar rotation) until it was fully canonicalized. Thus, the temporal relationship between planar and non-planar rotation differed for each rotation angle, with the non-planar rotation occurring at increasingly later intervals for different points in time for progressively larger rotation angles. These findings have relevant methodological implications for studies investigating the psychophysiological correlates of the mental rotation of mirror letters.

The Effect of Mirror Visual Feedback Therapy on the Hand Mental Rotation in Stroke Patients: An ERP study

Mirror visual feedback (MVF) intervention is an adjunctive approach for motor recovery after stroke. It has been hypothesized that MVF can increase visual perception, motor imagery, and attention of/to the hands. However, neuroimaging evidence for this hypothesis is still lacking. In this study, we used a hand mental rotation task and event-related potential (ERP) analysis to explore the effect of MVF intervention on visual perception, motor preparation, and motor imagery of hands. We recruited 46 patients and randomly divided them into a mirror visual feedback group (MG) and a conventional intervention group (CG). By comparing ERP amplitude between the two groups and between before and after the intervention, we found that the N200 component, which was considered to be related to motor preparation, was significantly less negative in the affected hemisphere than that in the unaffected counterpart. After intervention, the N200 amplitude became more negative, reflecting a recovery of motor preparation. Specifically, MG showed a significant effect on the N200 for the hand pictures at large orientations, while the CG showed an effect mainly for the upright hand stimuli. The results suggested an improvement of preparation for motor imagery of complex and precise hand movements after MVF intervention.Clinical Relevance- This study might be helpful for understanding the neural mechanisms of MVF which can help stroke patients regain upper extremity function.

The role of low-frequency oscillations in three-dimensional perception with depth cues in virtual reality

Currently, vision-related neuroscience studies are undergoing a trend from simplified image stimuli toward more naturalistic stimuli. Virtual reality (VR), as an emerging technology for visual immersion, provides more depth cues for three-dimensional (3D) presentation than two-dimensional (2D) image. It is still unclear whether the depth cues used to create 3D visual perception modulate specific cortical activation. Here, we constructed two visual stimuli presented by stereoscopic vision in VR and graphical projection with 2D image, respectively, and used electroencephalography to examine neural oscillations and their functional connectivity during 3D perception. We find that neural oscillations are specific to delta and theta bands in stereoscopic vision and the functional connectivity in the both bands increase in cortical areas related to visual pathways. These findings indicate that low-frequency oscillations play an important role in 3D perception with depth cues.

Neurophysiology of embodied mental rotation: Event-related potentials in a mental rotation task with human bodies as compared to alphanumeric stimuli

The present study examines if the neural signature of information processing in mental rotation tasks is moderated by stimulus characteristics (e.g., body-related vs. non-body-related stimuli). In the present experiment, stimulus sets of human figures (back view; left vs. right arm abduction) and alphanumeric characters ('R'; normal vs. mirrored view) were scrutinized with event-related potentials (ERPs) in the electroencephalography (EEG). Participants had to judge parity between an upright (0° orientation) and a comparison stimulus (stimulus disparity; 0°, 45°, 90°, 135° or 180°). There was a main effect of stimulus disparity for the behavioural (response time and error rates), as well as for the neural data (rotation-related negativity, RRN). The interaction of stimulus disparity and stimulus type was significant for the RRN, but not for the response time. Lower RRN amplitudes for letters indicate a more pronounced use of alternative processes (e.g., memory retrieval), which seems to be reflected in higher N350 amplitudes. Moreover, the increase of the RRN amplitude and the increase in response time as a function of disparity were positively correlated. Task differences were evident for several ERP components (i.e., N150, P150 and N250), being independent of disparity, which might reflect differences in early and late object cognition prior to the mental rotation process itself. This might be associated with the task-dependent activation of embodied cognition processes in mental rotation tasks.

Decreased Event-Related Desynchronization of Mental Rotation Tasks in Young Tibetan Immigrants

The present study aimed to explore the cortical activity underlying mental rotation in high-altitude immigrants via the event-related desynchronization (ERD), the electroencephalogram time–frequency analysis, and source localization based on electroencephalographic data. When compared with the low-altitude individuals, the reaction time of mental rotation tasks was significantly slower in immigrants who had lived in high-altitude areas for 3 years. The time–frequency analysis showed that the alpha ERD and the beta ERD within the time window (400–700 ms) were decreased during the mental rotation tasks in these immigrants. The decreased ERD was observed at the parietal–occipital regions within the alpha band and at the central–parietal regions within the beta band. The decreased ERD might embody the sensorimotor-related cortical activity from hypoxia, which might be involved in cognitive control function in high-altitude immigrants, which provided insights into the neural mechanism of spatial cognition change on aspect of embodied cognition due to high-altitude exposure.

Learning Experience Reverses Catecholaminergic Effects on Adaptive Behavior

BACKGROUND

Catecholamines are important for cognitive control and the ability to adapt behavior (e.g., after response errors). A prominent drug that modulates the catecholaminergic system is methylphenidate. On the basis of theoretical consideration, we propose that the effects of methylphenidate on behavioral adaptation depend on prior learning experience.

METHODS

In a double-blind, randomized, placebo-controlled crossover study design, we examined the effect of methylphenidate (0.25 mg/kg) on post error behavioral adaptation processes in a group of n = 43 healthy young adults. Behavioral adaptation processes were examined in a working memory, modulated response selection task. The focus of the analysis was on order effects within the crossover study design to evaluate effects of prior learning/task experience.

RESULTS

The effect of methylphenidate/placebo on post-error behavioral adaptation processes reverses depending on prior task experience. When there was no prior experience with the task, methylphenidate increased post-error slowing and thus intensified behavioral adaptation processes. However, when there was prior task experience, (i.e., when the placebo session was conducted first in the crossover design), methylphenidate even decreased post-error slowing and behavioral adaptation. Effect sizes were large and the power of the observed effects was higher than 95%.

CONCLUSIONS

The data suggest that catecholaminergic effects on cognitive control functions vary as a function of prior learning/task experience. The data establish a close link between learning/task familiarization and catecholaminergic effects for executive functions, which has not yet been studied, to our knowledge, but is of considerable clinical relevance. Theoretical implications are discussed.

Catecholaminergic effects on inhibitory control depend on the interplay of prior task experience and working memory demands

BACKGROUND

Catecholamines affect response inhibition, but the effects of methylphenidate on inhibitory control in healthy subjects are heterogenous. Theoretical considerations suggest that working memory demands and learning/familiarization processes are important factors to consider regarding catecholaminergic effects on response inhibition.

AIMS

The purpose of this study was to examine the role of working memory demands and familiarization for methylphenidate effects on response inhibition.

METHODS

Twenty-eight healthy adults received a single dose of methylphenidate (0.5 mg/kg) or placebo in a randomised, double-blind, crossover study design. The subjects were tested using a working memory-modulated response inhibition paradigm that combined a Go/Nogo task with a mental rotation task.

RESULTS

Methylphenidate effects were largest in the most challenging mental rotation condition. The direction of effects depended on the extent of the participants' task experience. When performing the task for the first time, methylphenidate impaired response inhibition performance in the most challenging mental rotation condition, as reflected by an increased false alarm rate. In sharp contrast to this, methylphenidate seemed to improve response execution performance in the most challenging condition when performing the task for the second time as reflected by reaction times on Go trials.

CONCLUSION

Effects of catecholamines on inhibitory control processes depend on the interplay of two factors: (a) working memory demands, and (b) learning or familiarization with a task. It seems that the net effect of increases in gain control and decreases in working memory processes determines the methylphenidate effect on response inhibition. Hence, crossover study designs likely underestimate methylphenidate effects on cognitive functions.

Mental Rotation Effect on Adult Immigrants with Long-term Exposure to High Altitude in Tibet: An ERP Study

Human spatial manipulation ability is sensitive to high-altitude (HA) environment. The present study aimed to investigate the electrophysiological basis of spatial manipulation ability on adult immigrants with long-term HA exposure using the mental rotation (MR) task and the ERP approach. Toward this end, we explored the MR effect in individuals who immigrated to HA areas for three years compared with individuals who lived in low altitude areas. We found that the reaction time related to the MR effect was significantly slower in the HA group than that of the low-altitude group. The ERP component analysis further indicated that the rotation-related negativity (RRN) amplitude was highly corresponding to the MR effect in each group, the RRN amplitude was significantly larger in the HA group than the low-altitude group related to each rotation angle condition. The brain topographical map further showed that only the right hemisphere regions instead of the bilateral hemisphere regions involved into the MR effect in the HA group, which was different to the low-altitude group. Together, these findings might collectively suggest that the mental resource was insufficient as a result of HA exposure which can be reflected on the RRN amplitude, which may help understanding the neural basis of spatial ability change from the long-term HA exposure.

Objects Mental Rotation under 7 Days Simulated Weightlessness Condition: An ERP Study

During the spaceflight under weightlessness condition, human's brain function may be affected by the changes of physiological effects along with the distribution of blood and body fluids to the head. This variation of brain function will influence the performance of astronauts and therefore create possible harm to flight safety. This study employs 20 male subjects in a 7-day-6° head-down tilted (HDT) bed rest model to simulate physiological effects under weightlessness condition, and use behavioral, electrophysiological techniques to compare the changes of mental rotation ability (MR ability) before and after short-term simulated weightlessness state. Behavioral results suggested that significant linear relationship existed between the rotation angle of stimuli and the reaction time, which means mental rotation process do happen during the MR task in simulated weightlessness state. In the first 3 days, the P300 component induced by object mental rotation followed the "down-up-down" pattern. In the following 4 days it changed randomly. On HDT D2, the mean of the amplitude of the P300 was the lowest, while increased gently on HDT D3. There was no obvious changing pattern of the amplitude of P300 observed after 3 days of HDT. Simulated weightlessness doesn't change the basic process of mental rotation. The effect of simulated weightlessness is neural mechanism of self-adaptation. MR ability didn't bounce back to the original level after HDT test.

Mirror-normal difference in the late phase of mental rotation: An ERP study

Mirror-normal letter discriminations are thought to require mental rotation in order to transform the rotated alphanumeric character into its canonical orientation. Moreover, out-of-plane rotation is likely to occur after in-plane rotation to fully normalize the mirror version before the final mirror-normal judgment. The so-called rotation-related negativity, which varies with orientation, is found in both ERPonset (averaged with respect to stimulus onset) and ERPRT (averaged with respect to response time), representing the involvement of mental rotation in both time windows. Additionally, the mean amplitude of ERPRT correlates with individual performance. We performed a comprehensive analysis of the mirror-normal differences in the early and late phases of mental rotation and deduced that out-of-plane rotation is more likely to occur in the late phase and interacts with both in-plane rotation and the decision-making process, as indicated by both behavioral and electrophysiological findings.

Mental rotation: an examination of assumptions

Since first presented by Shepard and Metzler, Science 1971, 171: 701-703, mental rotation has been described as a rotary transformation of a visual stimulus allowing it to be represented in a new orientation. For a given stimulus, the transformation is thought to occur at a constant speed, though speed may vary between stimuli; three-dimensional abstract shapes made out of blocks tend to be rotated much more slowly than alphanumeric characters or line drawings of common objects. Rotation is also presumed to be performed through the shortest angle. These assumptions are based upon the fact that response times tend to increase with angle of rotation, peaking at 180° of separation for abstract block figures or from upright for common objects and alphanumeric stimuli. The symmetry about 180° provides evidence supporting rotation through the shortest angle. In order to determine the shortest direction, the current orientation of the stimulus is assumed to be known prior to mental rotation. Moreover, in order to determine the current orientation of a common object or alphanumeric stimulus, it is assumed the stimulus is identified prior to mental rotation because the current orientation is defined by what the object is. In mirror/normal discriminations or left/right facing discriminations of rotated stimuli response times are often examined by collapsing over response options as this variable is assumed to be uninteresting in terms of mental rotation. This article examines these assumptions, and suggests that many of them are not entirely safe. WIREs Cogn Sci 2017, 8:e1443. doi: 10.1002/wcs.1443 For further resources related to this article, please visit the WIREs website.

The norepinephrine system affects specific neurophysiological subprocesses in the modulation of inhibitory control by working memory demands

Inhibitory control processes are known to be modulated by working memory demands. However, the neurobiological mechanisms behind these modulations are inconclusive. One important system to consider in this regard is the locus coeruleus (LC) norepinephrine (NE) system. In the current study the role of the LC-NE system by means of pupil diameter recordings that are integrated with neurophysiological (EEG) and source localization data were examined. A combined mental-rotation Go/Nogo task was used. The results show that increases in working memory load complicate response inhibition processes. On a neurophysiological level these effects were reflected by specific modulations in event-related potentials (ERPs) reflecting motor inhibition processes (i.e., Nogo-P3). Attentional selection processes (reflected by the P1 and N1) as well as pre-motor inhibition or conflict monitoring processes (reflected by the Nogo-N2) were not affected. Activity of the LC-NE systems, as indexed by the pupil diameter data, predicted neurophysiological processes selectively in the Nogo-P3 time range. Source localization analyses suggest that this modulation occurs in the right middle and inferior frontal gyrus. The study provides evidence that the LC-NE system is an important neurobiological system modulating the effects of working memory load on response inhibition processes. More specifically, it modulates a subset of dissociable cognitive processes that are related to prefrontal cortical regions. Hum Brain Mapp 38:68-81, 2017. © 2016 Wiley Periodicals, Inc.

Different Effects of Hypoxia on Mental Rotation of Normal and Mirrored Letters: Evidence from the Rotation-Related Negativity

The present study explored the neural mechanism underlying the effect of moderate and transient hypoxic exposure on mental rotation of two-dimensional letters in both normal and mirror versions. Event-related potential data and behavioral data were acquired in the task of discrimination between normal and mirrored versions separately in conditions of normoxia (simulated sea level) and hypoxia conditions (simulated 5000 meter altitude). The behavioral results revealed no significant difference between the normoxia and hypoxia conditions both in response time and error rate. However, obvious differences between these two conditions in ERP were found. First, enlarged P300 and Rotation-related Negativity (RRN) were observed in the hypoxia condition compared to the normoxia condition only with normal letters. Second, the angle effect on the amplitude of RRN was more evident with normal letters in the hypoxia condition than that in the normoxia condition. However, this angle effect nearly disappeared with the mirrored letters in the hypoxia condition. Third, more bilateral parietal activation was observed in the hypoxia condition than the normoxia condition. These results suggested that the compensation mechanism existed in the hypoxia condition and was effective with normal letters but had little effect on the mirrored letters. This study extends the research about the hypoxic effect on spatial ability of humans by employing a mental rotation task and further provides neural evidence for this effect.

Neurocognitive impairment on motor imagery associated with positive symptoms in patients with first-episode schizophrenia: evidence from event-related brain potentials

Motor imagery provides direct insight into an anatomically interconnected system involved in the integration of sensory information with motor actions, a process that is associated with positive symptoms in schizophrenia (SCZ). However, very little is known about the electrophysiological processing of motor imagery in first episode SCZ. In the current study, we used a visual hand mental rotation (MR) paradigm to manipulate the processing of motor imagery while event-related brain potentials (ERPs) were recorded in 42 SCZ participants and 40 healthy controls (HC). The 400-600 ms window was measured and analyzed for peak latencies and amplitudes. Participants with SCZ had slower reaction time (RT) and made more errors than did HC participants. Moreover, SCZ participants had lower amplitudes in the 400-600 ms window and the typical MR function for amplitudes of MR was lacking. Interestingly, the scalp activity maps for MR in SCZ exhibited an absence of activation in the left parietal site as shown in HC. Furthermore, deficits of amplitude for MR were positively correlated with positive symptom scores in SCZ. These results provide novel evidence for relationships between the electrophysiological processing of motor imagery and positive symptoms in SCZ. They further suggest that the impaired information processing of motor imagery indexed by amplitudes and specific topographic characteristics of the EEG during MR tasks may be a potentially useful and early defining biomarker for SCZ.

Sex-specific lateralization of event-related potential effects during mental rotation of polygons

Mental rotation performance has been found to produce one of the largest sex differences in cognition. Many theories suggest that this effect should be accompanied by a sex difference in functional cerebral asymmetry, but empirical data are more than equivocal probably because of (a) the use of inappropriate stimuli and (b) insufficient power of most neurophysiological studies. Therefore, sex differences in mental rotation of polygons were investigated in 122 adults. Men outperformed women on mental rotation speed (as well as on response time and accuracy). On the basis of the electrophysiological brain correlates of mental rotation, we observed a bilateral brain activity for men, whereas women's brain activity was clearly lateralized toward the left hemisphere if and only if mental rotation was involved. Thus, sex differences in functional cerebral asymmetry can indeed be observed if appropriate stimuli are used in a sufficiently large sample.

Cognitive alterations in motor imagery process after left hemispheric ischemic stroke

BACKGROUND

Motor imagery training is a promising rehabilitation strategy for stroke patients. However, few studies had focused on the neural mechanisms in time course of its cognitive process. This study investigated the cognitive alterations after left hemispheric ischemic stroke during motor imagery task.

METHODOLOGY/PRINCIPAL FINDINGS

Eleven patients with ischemic stroke in left hemisphere and eleven age-matched control subjects participated in mental rotation task (MRT) of hand pictures. Behavior performance, event-related potential (ERP) and event-related (de)synchronization (ERD/ERS) in beta band were analyzed to investigate the cortical activation. We found that: (1) The response time increased with orientation angles in both groups, called "angle effect", however, stoke patients' responses were impaired with significantly longer response time and lower accuracy rate; (2) In early visual perceptual cognitive process, stroke patients showed hypo-activations in frontal and central brain areas in aspects of both P200 and ERD; (3) During mental rotation process, P300 amplitude in control subjects decreased while angle increased, called "amplitude modulation effect", which was not observed in stroke patients. Spatially, patients showed significant lateralization of P300 with activation only in contralesional (right) parietal cortex while control subjects showed P300 in both parietal lobes. Stroke patients also showed an overall cortical hypo-activation of ERD during this sub-stage; (4) In the response sub-stage, control subjects showed higher ERD values with more activated cortical areas particularly in the right hemisphere while angle increased, named "angle effect", which was not observed in stroke patients. In addition, stroke patients showed significant lower ERD for affected hand (right) response than that for unaffected hand.

CONCLUSIONS/SIGNIFICANCE

Cortical activation was altered differently in each cognitive sub-stage of motor imagery after left hemispheric ischemic stroke. These results will help to understand the underlying neural mechanisms of mental rotation following stroke and may shed light on rehabilitation based on motor imagery training.

Different mental rotation strategies reflected in the rotation related negativity

In a mental rotation task of objects, typically, reaction time (RT) increases and the rotation related negativity (RRN) increases in amplitude with increasing angles of rotation. However, in a mental rotation task of hands, different RT profiles can be observed for outward and inward rotated hands. In the present study, we examined the neurophysiological correlates of these asymmetries in the RT profiles. We used a mental rotation task with stimuli of left and right hands. In line with previous studies, the behavioral results showed a linear increase in RT for outward rotations, but not for inward rotations as a function of angular disparity. Importantly, the ERP results revealed an RRN for outward rotated stimuli, but not for inward rotated stimuli. This is the first study to show that the behaviorally observed differences in a mental rotation task of hands is also reflected at the neurophysiological level.

Repetition benefit in mental rotation is independent of stimulus repetition

In this study, we investigated whether there is a repetition benefit in mental rotation that is independent of stimulus repetition (i.e., due to increased efficiency in postencoding processing). Three experiments were conducted, in which different conditions of stimulus repetition (different letters on consecutive trials in Experiment 1, letters of different orientations on consecutive trials in Experiment 2, and priming of rotation direction in Experiment 3) were used, and the extent of repetition of rotation direction between two consecutive trials was manipulated. The results of all three experiments showed clear evidence of a repetition benefit without repeating the stimulus, suggesting that this effect is independent of stimulus repetition and lending support to the notion of increased efficiency in mental rotation as a result of repeated rotation direction per se.

Cortical networks for rotational uncertainty effect in mental rotation task by partial directed coherence analysis of EEG

Partial directed coherence (PDC) as a frequency-domain representation of Granger casuality (GC) could detect both strength and direction of cortical interactions by multivariate autoregressive (MVAR) model of electroencephalography (EEG). In the present study, we investigate the underlying neural networks mechanisms of "rotational uncertainty effect" during mental rotation (MR) task by PDC analysis of multichannel EEG signals before and after the visual stimuli presented, we found that (i) temporally the "rotational uncertainty effect" involved an activated network before the visual stimuli presented, which could also affect the cognitive process of MR later; (ii) the causality functional connectivity network indicated that the bi-directional frontal [symbol see text] parietal networks played critical roles in maintaining the readiness during the MR task. These findings suggest that functional networks of un-cued preparation before visual stimuli presented are worth to be paid more attention. And these networks provide crucial casuality information to understand the neural mechanism for "rotational uncertainty effect" in MR task.

The advantage of mentally rotating clockwise

The time taken to decide whether a character is shown in its mirror or normal version has been shown to increase approximately linearly with the angular departure from an up-right position. Additionally, in some studies, decisions took longer for clockwise tilted characters than for counterclockwise tilted ones. Other studies do not report the latter effect. We argue that inconsistencies across studies are caused by variance in participants' strategies. The task employed here was specifically designed to bring these strategies and thereby the direction of rotation under experimental control. From the EEG recorded during the rotation period, we extracted an event-related slow potential whose amplitude is sensitive to the amount of mental rotation. In both strategy conditions, the slow potential's amplitude was lower for clockwise than for counterclockwise rotations. We take this as evidence that mental rotation of alphanumeric characters is easier in a clockwise than in a counterclockwise direction.

Preschoolers' Mental Rotation: Sex Differences in Hemispheric Asymmetry

Mental rotation performance has been found to produce one of the largest sex differences in cognition accompanied by sex differences in functional cerebral asymmetry. Although sex differences in mental rotation performance can be reliably demonstrated as early as age 5 years old, that is, long before puberty, no data exist as to whether preschooler's mental rotation performance is accompanied by sex differences in functional cerebral asymmetry. Based on the electrophysiological brain correlates of mental rotation, we observed a bilateral parietal brain activity for preschool boys whereas the preschool girls' brain activity was clearly lateralized toward the left hemisphere if and only if mental rotation was needed to solve the task. Thus, sex differences in functional cerebral asymmetry during mental rotation do not require hormonal changes that occur during puberty.

Does Children’s Left Hemisphere Lateralization During Mental Rotation Depend Upon the Stimulus Material?

Recent publications suggest that there is a developmental-based change of lateralization of brain activity during mental rotation from left to bilateral. But it is an open question whether this left hemisphere activation could also be observed with stimuli other than characters. To test this, behavioral data and event-related potentials (ERPs) were measured in 28 children, 28 juveniles, and 28 adults during a mental rotation task with animal drawings. The results showed that reaction times (RTs) and error rates decreased with the increasing age of the participants. Furthermore, RTs and error rates increased with increasing angular disparity. An unlateralized ERP amplitude modulation at parietal electrodes as a function of angular disparity was present in all age groups. These results contrast former studies revealing a left lateralization in children when characters were used as stimuli for mental rotation. Left hemisphere activation is therefore not a general developmental trend; rather, it is suggested that it might be a correlate of written language acquisition.

Functional Neuroanatomy of Mental Rotation

Brain regions involved in mental rotation were determined by assessing increases in fMRI activation associated with increases in stimulus rotation during a mirror-normal parity-judgment task with letters and digits. A letter–digit category judgment task was used as a control for orientation-dependent neural processing unrelated to mental rotation per se. Compared to the category judgments, the parity judgments elicited increases in activation in both the dorsal and the ventral visual streams, as well as higher-order premotor areas, inferior frontal gyrus, and anterior insula. Only a subset of these areas, namely, the posterior part of the dorsal intraparietal sulcus, higher-order premotor regions, and the anterior insula showed increased activation as a function of stimulus orientation. Parity judgments elicited greater activation in the right than in the left ventral intraparietal sulcus, but there were no hemispheric differences in orientation-dependent activation, suggesting that neither hemisphere is dominant for mental rotation per se. Hemispheric asymmetries associated with parity-judgment tasks may reflect visuospatial processing other than mental rotation itself, which is subserved by a bilateral fronto-parietal network, rather than regions restricted to the posterior parietal.

Combining path analysis with time-resolved functional magnetic resonance imaging: the neurocognitive network underlying mental rotation

There is strong evidence to suggest that the complex cognitive process underlying mental rotation does not have a discrete neural correlate, but is represented as a distributed neural system. Although the neuroanatomical nodes of this so-called rotation network are well established, there is as yet little empirical evidence to indicate how these nodes interact during task performance. Using an optimized, event-related paradigm, this study aimed to test a previously proposed hypothetical neurocognitive network for mental rotation in female subjects with path analysis, and to examine changes in effective connections across different levels of task difficulty. Path analysis was carried out in combination with a time-resolved functional magnetic resonance imaging (fMRI) analysis in order to relate the observed changes on the network level to changes in specific temporal characteristics of the hemodynamic response function on the level of individual neuroanatomical nodes. Overall, it was found that the investigated sequential model did not provide an adequate fit to the data and that a model with parallel information processing was superior to the serial model. This finding challenges traditional cognitive models describing the complex cognitive process underlying mental rotation by a set of sequentially organized, functionally distinct processing stages. It was further demonstrated that the observed in interregional effective connectivity changes with the level of task demand. These changes were directly related to the time course of the experimental paradigm. The results of path analysis in fMRI should therefore only be interpreted in the light of a specific experimental design and should not be considered as general indicators of effective connections.

Computational mechanisms of object constancy for visual recognition revealed by event-related potentials

This study examined the functional organisation of the computational processes underlying orientation-dependent and orientation-invariant two-dimensional object recognition. Participants identified two previously memorised novel shapes at different image plane orientations while event-related potentials (ERPs) were recorded. A centro-parietal ERP component was found that peaked between 350 and 450 ms post-stimulus onset and whose amplitude was modulated by stimulus orientation only for objects showing an orientation effect in response times. These findings are consistent with a serial model of object recognition whereby object constancy is achieved in at least two successive steps: orientation-invariant feature extraction and orientation-dependent visuo-spatial transformation.

Learning-related changes of brain activation in the visual ventral stream: an fMRI study of mirror reading skill

A previous neuroimaging study has indicated that the visual dorsal stream may contribute to accurate reading of mirror-reversed words. However, the role of the visual ventral stream in the learning of mirror reading skill remains ambiguous. In the present fMRI study, we investigated learning-related changes in brain activation in the visual ventral stream in a mirror reading task. Subjects participated in three successive runs of the mirror reading task, in each of which they were asked to read mirror-reversed words and normal words as accurately and as quickly as possible. The behavioral data for the mirror reading condition showed significant improvement in reaction time but not in performance accuracy across the three runs. The activation data showed different learning-associated patterns related to the right and left visual ventral streams. On the right side, activity related to the reading of mirror stimuli was significantly greater than that related to normal stimuli in the first run only, whereas on the left side it was greater in all runs. Additional correlation analysis between response time data and percentage signal changes only in the mirror reading condition showed significant correlation on the right visual ventral stream in the first run only, whereas that on the left visual ventral stream was found only in the third run. The dissociable response between the right and left visual ventral streams may reflect learning-related changes in reading strategy and may be critical in improving the speed of reading mirror-reversed words.

Goodness takes effort: perceptual organization in dual-task settings

We adopted the Psychological Refractoriness Paradigm to study whether perceptual Goodness affects the load of central processing resources. In three dual-task experiments, 2-Alternative Forced Choice auditory classification was followed by a same-different task in which Garner's classical five-dot patterns were presented. Goodness of these patterns and stimulus-onset asynchrony (SOA) between the first and second task were varied between trials. These factors had additive effects on response latencies and accuracy, indicating that pattern Goodness determines central processing load in performing the same-different task. In a fourth experiment, same-different judgment with Garner patterns was the single task. SOA between the first and second pattern was varied. Over-additive effects of Goodness with decreasing SOA were obtained, indicating sharing of central resources between consolidation of the first Garner pattern and performing the same-different task. Whereas, the resources needed for the latter, again, depend on Goodness, those needed for consolidation are independent of it.

Effects of dynamic rotation on event-related brain potentials

Event-related potentials were recorded during a mental rotation task. Subjects were shown pairs of letter-like shapes and were asked to make a parity judgment. The shape on the left was always in its canonical position and the shape on the right could either be in its canonical position or be a mirror image. Two variables were manipulated for the shape on the right. First, it could appear at different orientations (50 degrees , 100 degrees or 150 degrees ); second, it could be presented in a stationary position, in a dynamic congruent direction (the shape slowly rotating toward its normal upright position) or in a dynamic incongruent direction (the shape slowly rotating in the opposite direction to its normal upright position). Orientation- and direction-dependent modulations of a negative slow wave were found. For orientation, the typical amplitude effect over parietal sites was found, the amplitude becoming more negative as the rotational angle increased. For direction, the amplitude of the negative slow wave was larger for stationary and dynamic incongruent trials than for dynamic congruent trials at 100 degrees and 150 degrees . This result suggests that presentation of a stimulus in a dynamic congruent direction facilitates the mental rotation process. At 50 degrees , differences between dynamic incongruent trials and both stationary and dynamic congruent trials were found, suggesting that the incongruent movement elicits an obstructing effect over the mental rotation process. In summary, the present experiment provides new evidence in support of the idea that the amplitude modulation over the parietal cortex is a psychophysiological marker of the mental rotation process.

Evidence of partial response activation in a memory-search task

Studies using the lateralized readiness potential (LRP; an index of hand-specific motor preparation), suggest that the motor system can be activated on the basis of partial information, providing support for a parallel view of the human information processing system. However, data to the contrary have been obtained in memory-search paradigms, leading Heil et al. [Psychological Research 62 (1999) 289] to propose that hand-specific motor preparation cannot occur in parallel with memory scanning. To further investigate these findings we recorded the LRP in a fast-paced memory search task, in which the case of target letter and memory set size were manipulated and a choice-go/no-go procedure was used. The case of the test letter determined the response hand, whereas membership of the test stimulus in the memory set determined whether a response was required. We found different types of LRP effects as a function of time on task. Analyses based on the data from the first half of the experiment replicated those obtained by Heil et al. [Psychological Research 62 (1999) 289]. However, unlike Heil et al. [Psychological Research 62 (1999) 289], the second half of the data showed significant LRP activity on no-go trials and similar LRP onset latencies for go and no-go trials, as well as for different memory set size conditions in the stimulus-locked LRP waveforms. The response-related waveforms showed an earlier LRP onset in the set-size 4 than in the set-size 2 condition. These data suggest that motor preparation can occur simultaneously with memory search when participants are sufficiently practiced. Time-on-task and strategy differences between the two studies are discussed.

Mental rotation delays the heart beat: Probing the central processing bottleneck

We tested the hypothesis that mental rotation would delay response-related processing as indicated by transient slowing of the heart beat. Thirty college-age subjects (half female) were presented with normal and mirror image letters rotated at 0, 60, 120, and 180 degrees. Three letters were assigned to a right-hand response; a separate three to a left-hand response. Responses were only required for letters in one orientation, mirror or normal. Continuous measures of interbeat interval (IBI) of the heart, respiration, and muscle tension were collected. Performance results were largely consistent with prior findings. Greater angular displacement of the stimuli was associated with greater lengthening of IBI immediately after the stimulus. IBI was influenced equally by angle of rotation in respond and inhibit trials. The lengthening of IBI was interpreted as due to a delay in response selection and execution due to mental rotation.

Non-identical neural mechanisms for two types of mental transformation: event-related potentials during mental rotation and mental paper folding

Reaction times, accuracy and 128-channel event-related potentials (ERPs) were measured from 14 normal, right-handed subjects while they performed two different parity-judgment tasks that require transformations of mental images: a relatively simple task requiring a single transformation (mental letter rotation), and a more complex task involving a coordinated sequence of transformations (mental paper folding). Reaction times increased monotonically with larger angular displacements from the upright (for mental rotation) and with number of squares carried (for mental paper folding). Both the tasks resulted in amplitude modulation of an approximately 420-700 ms latency ERP component at parietal electrodes. Scalp topographies indicated that right parietal cortex was activated during mental rotation, but bilateral parietal regions were activated during mental paper folding. Our results support the notion of a right hemispheric superiority for tasks involving simple, single mental rotations, but indicate greater involvement of the left hemisphere when a more complex sequence of transformations are required. This task-dependent lability of hemispheric function may account for some of the inconsistent results reported by previous neuroimaging and electrophysiological studies.

Cerebral asymmetry for mental rotation: effects of response hand, handedness and gender

We assessed lateralization of brain function during mental rotation, measuring the scalp distribution of a 400-600 ms latency event-related potential (ERP) with 128 recording electrodes. Twenty-four subjects, consisting of equal numbers of dextral and sinistral males and females, performed a mental rotation task under two response conditions (dominant non-dominant hand). For males, ERPs showed a right parietal bias regardless of response hand. For females, the parietal ERPs were slightly left-lateralized when making dominant hand responses, but strongly right-lateralized when making non-dominant hand responses. These results support the notion that visuo-spatial processing is more bilaterally organized in females. However, left hemisphere resources may be allocated to response preparation when using the non-dominant hand, forcing visuo-spatial processing to the right hemisphere.

When in doubt, do it both ways: brain evidence of the simultaneous activation of conflicting motor responses in a spatial stroop task

Response competition is often considered an important contributor to the delayed reaction to stimuli for which physical and semantic information are in conflict ("Stroop" effect). Response competition implies that brain areas associated with correct and incorrect responses (e.g., left and right motor cortices) should be simultaneously activated in conflict conditions. However, there is at present little direct evidence of this phenomenon, in part because of the paucity of brain imaging techniques that can independently monitor the time course of activation of adjacent brain areas, such as the motor areas. In the present study, we show that the event-related optical signal (EROS) can provide these types of data. The results confirm the prediction that conflict trials elicit simultaneous activation of both motor cortices, whereas nonconflict trials elicit brain activity only in the contralateral motor cortex. These data support a parallel view of the human information processing system.