1
|
Fritz C, Zimmermann E. Temporal adaptation of sensory attenuation for self-touch. Exp Brain Res 2023; 241:2333-2344. [PMID: 37606713 PMCID: PMC10471680 DOI: 10.1007/s00221-023-06688-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 08/11/2023] [Indexed: 08/23/2023]
Abstract
The sensory consequences of our actions appear attenuated to us. This effect has been reported for external sensations that are evoked by auditory or visual events and for body-related sensations which are produced by self-touch. In the present study, we investigated the effects of prolonged exposure to a delay between an action and the generated sensation on sensory attenuation for self-touch. Previously, it has been shown that after being presented to a systematic exposure delay, artificially delayed touch can feel more intense and non-delayed touches can appear less intense. Here, we investigated the temporal spread of the temporal recalibration effect. Specifically, we wondered whether this temporal recalibration effect would affect only the delay that was used during exposure trials or if it would also modulate longer test delays. In the first two experiments, we tested three test delays (0, 100 and 400 ms) either in randomized or in blocked order. We found sensory attenuation in all three test intervals but no effect of the exposure delay. In Experiment 3, we replicated the experiment by Kilteni et al. (ELife 8:e42888, 2019. https://doi.org/10.7554/eLife.42888 ) and found evidence for temporal recalibration by exposure delay. Our data show that the temporal selectivity of sensory attenuation of self-touch depends on presenting a singular test delay only. Presenting multiple test delays leads to a temporally broad spread of sensory attenuation.
Collapse
Affiliation(s)
- Clara Fritz
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
| | - Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
2
|
Zhang Z, Lin X, Bao Y. Holistic temporal order judgment of tones requires top-down disentanglement. Psych J 2023; 12:491-499. [PMID: 36137943 DOI: 10.1002/pchj.603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 08/17/2022] [Indexed: 08/12/2023]
Abstract
How temporal sequence gets organized is a central topic in cognitive processing. In a high-frequency time window of tens of milliseconds, the temporal order is reconstructed rather than mirroring the sequence of events objectively in physical time. Two separate phases or strategies, a holistic coding phase that groups successively presented events as a gestalt and a disentanglement phase that decodes the temporal order of discrete events from the gestalt representation, may presumably be involved in the perception of temporal order across different modalities. With a temporal order adaptation protocol of pure tones using glide adaptors, the present study demonstrated a dissociation between constant discriminability and shifted subjective simultaneity across different adaptor directions. While discriminability of temporal order was not adapted by glides, revealing a constant coding sensitivity of different asynchronies, the shift of subjective simultaneity indicated the recalibration of a top-down disentanglement of the holistic processing under the influence of glide adaptors. The results suggest a dual-phase holistic processing in temporal order perception, supporting two separate cognitive strategies for event timing on the sub-second level.
Collapse
Affiliation(s)
- Zhilin Zhang
- School of Psychological and Cognitive Sciences, Peking University, Beijing
- Yuanpei College, Peking University, Beijing, China
- Department of Psychology, New York University, New York, USA
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
| | - Xiaoxiong Lin
- School of Psychological and Cognitive Sciences, Peking University, Beijing
- Graduate School of Systemic Neurosciences, Ludwig Maximilian University, Munich, Germany
- Department of Neurosurgery, Klinikum rechts der Isar der Technischen Universität München
| | - Yan Bao
- School of Psychological and Cognitive Sciences, Peking University, Beijing
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing
| |
Collapse
|
3
|
Li N, Liu J, Xie Y, Ji W, Chen Z. Age-related decline of online visuomotor adaptation: a combined effect of deteriorations of motor anticipation and execution. Front Aging Neurosci 2023; 15:1147079. [PMID: 37409009 PMCID: PMC10318141 DOI: 10.3389/fnagi.2023.1147079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 05/30/2023] [Indexed: 07/07/2023] Open
Abstract
The literature has established that the capability of visuomotor adaptation decreases with aging. However, the underlying mechanisms of this decline are yet to be fully understood. The current study addressed this issue by examining how aging affected visuomotor adaptation in a continuous manual tracking task with delayed visual feedback. To distinguish separate contributions of the declined capability of motor anticipation and deterioration of motor execution to this age-related decline, we recorded and analyzed participants' manual tracking performances and their eye movements during tracking. Twenty-nine older people and twenty-three young adults (control group) participated in this experiment. The results showed that the age-related decline of visuomotor adaptation was strongly linked to degraded performance in predictive pursuit eye movement, indicating that declined capability motor anticipation with aging had critical influences on the age-related decline of visuomotor adaptation. Additionally, deterioration of motor execution, measured by random error after controlling for the lag between target and cursor, was found to have an independent contribution to the decline of visuomotor adaptation. Taking these findings together, we see a picture that the age-related decline of visuomotor adaptation is a joint effect of the declined capability of motor anticipation and the deterioration of motor execution with aging.
Collapse
Affiliation(s)
- Na Li
- Shanghai Changning Mental Health Center, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics, Affiliated Mental Health Center, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Junsheng Liu
- Shanghai Changning Mental Health Center, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics, Affiliated Mental Health Center, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Yong Xie
- Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai, China
| | - Weidong Ji
- Shanghai Changning Mental Health Center, Shanghai, China
| | - Zhongting Chen
- Shanghai Key Laboratory of Brain Functional Genomics, Affiliated Mental Health Center, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| |
Collapse
|
4
|
Schmitter CV, Straube B. The impact of cerebellar transcranial direct current stimulation (tDCS) on sensorimotor and inter-sensory temporal recalibration. Front Hum Neurosci 2022; 16:998843. [PMID: 36111210 PMCID: PMC9468227 DOI: 10.3389/fnhum.2022.998843] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 08/12/2022] [Indexed: 12/02/2022] Open
Abstract
The characteristic temporal relationship between actions and their sensory outcomes allows us to distinguish self- from externally generated sensory events. However, the complex sensory environment can cause transient delays between action and outcome calling for flexible recalibration of predicted sensorimotor timing. Since the neural underpinnings of this process are largely unknown this study investigated the involvement of the cerebellum by means of cerebellar transcranial direct current stimulation (ctDCS). While receiving anodal, cathodal, dual-hemisphere or sham ctDCS, in an adaptation phase, participants were exposed to constant delays of 150 ms between actively or passively generated button presses and visual sensory outcomes. Recalibration in the same (visual outcome) and in another sensory modality (auditory outcome) was assessed in a subsequent test phase during which variable delays between button press and visual or auditory outcome had to be detected. Results indicated that temporal recalibration occurred in audition after anodal ctDCS while it was absent in vision. As the adaptation modality was visual, effects in audition suggest that recalibration occurred on a supra-modal level. In active conditions, anodal ctDCS improved sensorimotor recalibration at the delay level closest to the adaptation delay, suggesting a precise cerebellar-dependent temporal recalibration mechanism. In passive conditions, the facilitation of inter-sensory recalibration by anodal ctDCS was overall stronger and tuned to larger delays. These findings point to a role of the cerebellum in supra-modal temporal recalibration across sensorimotor and perceptual domains, but the differential manifestation of the effect across delay levels in active and passive conditions points to differences in the underlying mechanisms depending on the availability of action-based predictions. Furthermore, these results suggest that anodal ctDCS can be a promising tool for facilitating effects of temporal recalibration in sensorimotor and inter-sensory contexts.
Collapse
Affiliation(s)
- Christina V. Schmitter
- Department of Psychiatry and Psychotherapy, University of Marburg, Marburg, Germany
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University Giessen, Marburg, Germany
- *Correspondence: Christina V. Schmitter,
| | - Benjamin Straube
- Department of Psychiatry and Psychotherapy, University of Marburg, Marburg, Germany
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University Giessen, Marburg, Germany
| |
Collapse
|
5
|
Arikan BE, van Kemenade BM, Fiehler K, Kircher T, Drewing K, Straube B. Different contributions of efferent and reafferent feedback to sensorimotor temporal recalibration. Sci Rep 2021; 11:22631. [PMID: 34799622 PMCID: PMC8604902 DOI: 10.1038/s41598-021-02016-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Accepted: 11/08/2021] [Indexed: 01/10/2023] Open
Abstract
Adaptation to delays between actions and sensory feedback is important for efficiently interacting with our environment. Adaptation may rely on predictions of action-feedback pairing (motor-sensory component), or predictions of tactile-proprioceptive sensation from the action and sensory feedback of the action (inter-sensory component). Reliability of temporal information might differ across sensory feedback modalities (e.g. auditory or visual), which in turn influences adaptation. Here, we investigated the role of motor-sensory and inter-sensory components on sensorimotor temporal recalibration for motor-auditory (button press-tone) and motor-visual (button press-Gabor patch) events. In the adaptation phase of the experiment, action-feedback pairs were presented with systematic temporal delays (0 ms or 150 ms). In the subsequent test phase, audio/visual feedback of the action were presented with variable delays. The participants were then asked whether they detected a delay. To disentangle motor-sensory from inter-sensory component, we varied movements (active button press or passive depression of button) at adaptation and test. Our results suggest that motor-auditory recalibration is mainly driven by the motor-sensory component, whereas motor-visual recalibration is mainly driven by the inter-sensory component. Recalibration transferred from vision to audition, but not from audition to vision. These results indicate that motor-sensory and inter-sensory components contribute to recalibration in a modality-dependent manner.
Collapse
Affiliation(s)
- Belkis Ezgi Arikan
- Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel Strasse 10F, 35394, Giessen, Germany. .,Center for Mind, Brain and Behavior (CMBB), Philipps University Marburg and Justus Liebig University Giessen, Hans-Meerwein-Strasse 6, 35032, Marburg, Germany.
| | - Bianca M. van Kemenade
- grid.8756.c0000 0001 2193 314XInstitute of Neuroscience and Psychology, University of Glasgow, 62 Hillhead Street, Glasgow, G12 8QB UK ,grid.10253.350000 0004 1936 9756Department of Psychiatry and Psychotherapy, Philipps University Marburg, Rudolf-Bultmann-Strasse 8, 35039 Marburg, Germany
| | - Katja Fiehler
- grid.8664.c0000 0001 2165 8627Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel Strasse 10F, 35394 Giessen, Germany ,Center for Mind, Brain and Behavior (CMBB), Philipps University Marburg and Justus Liebig University Giessen, Hans-Meerwein-Strasse 6, 35032 Marburg, Germany
| | - Tilo Kircher
- Center for Mind, Brain and Behavior (CMBB), Philipps University Marburg and Justus Liebig University Giessen, Hans-Meerwein-Strasse 6, 35032 Marburg, Germany ,grid.10253.350000 0004 1936 9756Department of Psychiatry and Psychotherapy, Philipps University Marburg, Rudolf-Bultmann-Strasse 8, 35039 Marburg, Germany
| | - Knut Drewing
- grid.8664.c0000 0001 2165 8627Experimental Psychology, Justus Liebig University Giessen, Otto-Behaghel Strasse 10F, 35394 Giessen, Germany
| | - Benjamin Straube
- Center for Mind, Brain and Behavior (CMBB), Philipps University Marburg and Justus Liebig University Giessen, Hans-Meerwein-Strasse 6, 35032 Marburg, Germany ,grid.10253.350000 0004 1936 9756Department of Psychiatry and Psychotherapy, Philipps University Marburg, Rudolf-Bultmann-Strasse 8, 35039 Marburg, Germany
| |
Collapse
|
6
|
White PA. The extended present: an informational context for perception. Acta Psychol (Amst) 2021; 220:103403. [PMID: 34454251 DOI: 10.1016/j.actpsy.2021.103403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Revised: 08/04/2021] [Accepted: 08/19/2021] [Indexed: 01/29/2023] Open
Abstract
Several previous authors have proposed a kind of specious or subjective present moment that covers a few seconds of recent information. This article proposes a new hypothesis about the subjective present, renamed the extended present, defined not in terms of time covered but as a thematically connected information structure held in working memory and in transiently accessible form in long-term memory. The three key features of the extended present are that information in it is thematically connected, both internally and to current attended perceptual input, it is organised in a hierarchical structure, and all information in it is marked with temporal information, specifically ordinal and duration information. Temporal boundaries to the information structure are determined by hierarchical structure processing and by limits on processing and storage capacity. Supporting evidence for the importance of hierarchical structure analysis is found in the domains of music perception, speech and language processing, perception and production of goal-directed action, and exact arithmetical calculation. Temporal information marking is also discussed and a possible mechanism for representing ordinal and duration information on the time scale of the extended present is proposed. It is hypothesised that the extended present functions primarily as an informational context for making sense of current perceptual input, and as an enabler for perception and generation of complex structures and operations in language, action, music, exact calculation, and other domains.
Collapse
|
7
|
Sugano Y. Audiomotor Temporal Recalibration Modulates Decision Criterion of Self-Agency but Not Perceptual Sensitivity. Front Psychol 2021; 12:580441. [PMID: 33981264 PMCID: PMC8107242 DOI: 10.3389/fpsyg.2021.580441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 03/01/2021] [Indexed: 11/13/2022] Open
Abstract
Exposure to delayed sensory feedback changes perceived simultaneity between action and feedback [temporal recalibration (TR)] and even modulates the sense of agency (SoA) over the feedback. To date, however, it is not clear whether the modulation of SoA by TR is caused by a change in perceptual sensitivity or decision criterion of self-agency. This experimental research aimed to tease apart these two by applying the signal detection theory (SDT) to the agency judgment over auditory feedback after voluntary action. Participants heard a short sequence of tone pips with equal inter-onset intervals, and they reproduced it by pressing a computer mouse. The delay of each tone pip after the mouse press was manipulated as 80 (baseline) or 180 ms (delayed). Subsequently, the participants reproduced it, in which the delay was fixed at 80 ms and there was a 50% chance that the computer took over the control of the tone pips from the participants. The participants’ task was to discriminate who controlled the tone pips and to judge synchrony between tone pips and mouse presses. Results showed that the modulation of the SoA by the TR is caused by a shift in the decision criterion but not in the perceptual sensitivity of agency.
Collapse
Affiliation(s)
- Yoshimori Sugano
- Department of Business and Marketing, Faculty of Commerce, Kyushu Sangyo University, Fukuoka, Japan
| |
Collapse
|
8
|
Cámara C, López-Moliner J, Brenner E, de la Malla C. Looking away from a moving target does not disrupt the way in which the movement toward the target is guided. J Vis 2021; 20:5. [PMID: 32407436 PMCID: PMC7409596 DOI: 10.1167/jov.20.5.5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
People usually follow a moving object with their gaze if they intend to interact with it. What would happen if they did not? We recorded eye and finger movements while participants moved a cursor toward a moving target. An unpredictable delay in updating the position of the cursor on the basis of that of the invisible finger made it essential to use visual information to guide the finger's ongoing movement. Decreasing the contrast between the cursor and the background from trial to trial made it difficult to see the cursor without looking at it. In separate experiments, either participants were free to hit the target anywhere along its trajectory or they had to move along a specified path. In the two experiments, participants tracked the cursor rather than the target with their gaze on 13% and 32% of the trials, respectively. They hit fewer targets when the contrast was low or a path was imposed. Not looking at the target did not disrupt the visual guidance that was required to deal with the delays that we imposed. Our results suggest that peripheral vision can be used to guide one item to another, irrespective of which item one is looking at.
Collapse
|
9
|
Knelange EB, López-Moliner J. Increased error-correction leads to both higher levels of variability and adaptation. PLoS One 2020; 15:e0227913. [PMID: 32017774 PMCID: PMC6999875 DOI: 10.1371/journal.pone.0227913] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 01/02/2020] [Indexed: 11/18/2022] Open
Abstract
In order to intercept moving objects, we need to predict the spatiotemporal features of the motion of both the object and our hand. Our errors can result in updates of these predictions to benefit interceptions in the future (adaptation). Recent studies claim that task-relevant variability in baseline performance can help adapt to perturbations, because initial variability helps explore the spatial demands of the task. In this study, we examined whether this relationship is also found in interception (temporal domain) by looking at the link between the variability of hand-movement speed during baseline trials, and the adaptation to a temporal perturbation. 17 subjects performed an interception task on a graphic tablet with a stylus. A target moved from left to right or vice versa, with varying speed across trials. Participants were instructed to intercept this target with a straight forward movement of their hand. Their movements were represented by a cursor that was displayed on a screen above the tablet. To prevent online corrections we blocked the hand from view, and a part of the cursor's trajectory was occluded. After a baseline phase of 80 trials, a temporal delay of 100 ms was introduced to the cursor representing the hand (adaptation phase: 80 trials). This delay initially caused participants to miss the target, but they quickly accounted for these errors by adapting to most of the delay of the cursor. We found that variability in baseline movement velocity is a good predictor of temporal adaptation (defined as a combination of the rate of change and the asymptotic level of change after a perturbation), with higher variability during baseline being associated with better adaptation. However, cross-correlation results suggest that the increased variability is the result of increased error correction, rather than exploration.
Collapse
Affiliation(s)
- Elisabeth B. Knelange
- Department of Cognition, Development and Psychology of Education, Vision and Control of Action (VISCA) Group, Institut de Neurociències, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Joan López-Moliner
- Department of Cognition, Development and Psychology of Education, Vision and Control of Action (VISCA) Group, Institut de Neurociències, Universitat de Barcelona, Barcelona, Catalonia, Spain
- * E-mail:
| |
Collapse
|
10
|
Distinct mechanisms govern recalibration to audio-visual discrepancies in remote and recent history. Sci Rep 2019; 9:8513. [PMID: 31186503 PMCID: PMC6559981 DOI: 10.1038/s41598-019-44984-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 05/28/2019] [Indexed: 11/08/2022] Open
Abstract
To maintain perceptual coherence, the brain corrects for discrepancies between the senses. If, for example, lights are consistently offset from sounds, representations of auditory space are remapped to reduce this error (spatial recalibration). While recalibration effects have been observed following both brief and prolonged periods of adaptation, the relative contribution of discrepancies occurring over these timescales is unknown. Here we show that distinct multisensory recalibration mechanisms operate in remote and recent history. To characterise the dynamics of this spatial recalibration, we adapted human participants to audio-visual discrepancies for different durations, from 32 to 256 seconds, and measured the aftereffects on perceived auditory location. Recalibration effects saturated rapidly but decayed slowly, suggesting a combination of transient and sustained adaptation mechanisms. When long-term adaptation to an audio-visual discrepancy was immediately followed by a brief period of de-adaptation to an opposing discrepancy, recalibration was initially cancelled but subsequently reappeared with further testing. These dynamics were best fit by a multiple-exponential model that monitored audio-visual discrepancies over distinct timescales. Recent and remote recalibration mechanisms enable the brain to balance rapid adaptive changes to transient discrepancies that should be quickly forgotten against slower adaptive changes to persistent discrepancies likely to be more permanent.
Collapse
|
11
|
Knelange EB, López-Moliner J. Decreased Temporal Sensorimotor Adaptation Due to Perturbation-Induced Measurement Noise. Front Hum Neurosci 2019; 13:46. [PMID: 30837854 PMCID: PMC6382734 DOI: 10.3389/fnhum.2019.00046] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Accepted: 01/28/2019] [Indexed: 11/15/2022] Open
Abstract
In daily life, we often need to make accurate and precise movements. However, our movements do not always end up as intended. When we are consistently too late to catch a ball for example, we need to update the predictions of the temporal consequences of our motor commands. These predictions can be improved when the brain evaluates sensory error signals. This is thought to be an optimal process, in which the relative reliabilities of the error signal and the prediction determine how much of an error is updated. Perturbation paradigms are used to identify how the brain learns from errors. Temporal perturbations (delays) between sensory signals impede the multisensory integration of these signals. Adaptation to these perturbations is often incomplete. We propose that the lack of adaptation is caused by an increased measurement noise that accompanies the temporal perturbation. We use a modification of the standard Kalman filter that allows for increases in measurement uncertainty with larger delays, and verify this model with a timing task on a screen. Participants were instructed to press a button when a ball reached a vertical line. Temporal feedback was given visually (unisensory consequence) or visually and auditory (multisensory consequence). The consequence of their button press was delayed incrementally with one ms per trial. Participants learned from their errors and started pressing the button earlier, but did not adapt fully. We found that our model, a Kalman filter with non-stationary measurement variance, could account for this pattern. Measurement variance increased less for the multisensory than the unisensory condition. In addition, we simulated our model's output for other perturbation paradigms and found that it could also account for fast de-adaptation. Our paper highlights the importance of evaluating changes in measurement noise when interpreting the results motor learning tasks that include perturbation paradigms.
Collapse
Affiliation(s)
- Elisabeth B Knelange
- Vision and Control of Action Group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain
| | - Joan López-Moliner
- Vision and Control of Action Group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain
| |
Collapse
|
12
|
Kahl S, Kopp S. A Predictive Processing Model of Perception and Action for Self-Other Distinction. Front Psychol 2018; 9:2421. [PMID: 30559703 PMCID: PMC6287016 DOI: 10.3389/fpsyg.2018.02421] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Accepted: 11/19/2018] [Indexed: 11/13/2022] Open
Abstract
During interaction with others, we perceive and produce social actions in close temporal distance or even simultaneously. It has been argued that the motor system is involved in perception and action, playing a fundamental role in the handling of actions produced by oneself and by others. But how does it distinguish in this processing between self and other, thus contributing to self-other distinction? In this paper we propose a hierarchical model of sensorimotor coordination based on principles of perception-action coupling and predictive processing in which self-other distinction arises during action and perception. For this we draw on mechanisms assumed for the integration of cues for a sense of agency, i.e., the sense that an action is self-generated. We report results from simulations of different scenarios, showing that the model is not only able to minimize free energy during perception and action, but also showing that the model can correctly attribute sense of agency to own actions.
Collapse
Affiliation(s)
- Sebastian Kahl
- Social Cognitive Systems Group, CITEC, Bielefeld University, Bielefeld, Germany
| | - Stefan Kopp
- Social Cognitive Systems Group, CITEC, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
13
|
Effects of prolonged exposure to feedback delay on the qualitative subjective experience of virtual reality. PLoS One 2018; 13:e0205145. [PMID: 30356243 PMCID: PMC6200207 DOI: 10.1371/journal.pone.0205145] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2018] [Accepted: 09/20/2018] [Indexed: 11/30/2022] Open
Abstract
When interacting with virtual environments, feedback delays between making a movement and seeing the visual consequences of that movement are detrimental for the subjective quality of the VR experience. Here we used standard measures of subjective experiences such as ownership, agency and presence to investigate whether prolonged exposure to the delay, and thus the possibility to adapt to it, leads to the recovery of the qualitative experience of VR. Participants performed a target-tracking task in a Virtual Reality environment. We measured the participants’ tracking performance in terms of spatial and temporal errors with respect to the target in both No-Delay and Delay conditions. Additionally, participants rated their sense of “ownership” of holding a virtual tool, agency and presence on each trial using sliding scales. These single trial ratings were compared to the results of the more traditional questionnaires for ownership and agency and presence for both No-Delay and Delay conditions. We found that the participants’ sliding scales ratings corresponded very well to the scores obtained from the traditional questionnaires. Moreover, not only did participants behaviourally adapt to the delay, their ratings of ownership and agency significantly improved with prolonged exposure to the delay. Together the results suggest a tight link between the ability to perform a behavioural task and the subjective ratings of ownership and agency in virtual reality.
Collapse
|
14
|
Cattan E, Perrier P, Bérard F, Gerber S, Rochet-Capellan A. Adaptation to visual feedback delays on touchscreens with hand vision. Exp Brain Res 2018; 236:3191-3201. [PMID: 30191261 DOI: 10.1007/s00221-018-5368-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Accepted: 08/25/2018] [Indexed: 11/25/2022]
Abstract
Direct touch finger interaction on a smartphone or a tablet is now ubiquitous. However, the latency inherent in digital computation produces an average feedback delay of ~ 75 ms between the action of the hand and its visible effect on digital content. This delay has been shown to affect users' performance, but it is unclear whether users adapt to this delay and whether it influences skill learning. Previous work studied adaptation to feedback delays but only for longer delays, with hidden hand or indirect devices. This paper addresses adaptation to touchscreen delay in two empirical studies involving the tracking of a target moving along an elliptical path. Participants were trained for the task either at the minimal delay the system allows (~ 9 ms) or at a longer delay equivalent to commercialized touch devices latencies (75 ms). After 10 training sessions over a minimum of 2 weeks (Experiment 1), participants adapt to the delay. They also display long-term retention 7 weeks after the last training session. This adaptation generalizes to a similar tracking path (e.g., infinity symbol). We also observed generalization of learning from the longer delay to the minimal-delay condition (Experiment 2). The delay thus does not prevent the learning of tracking skill, which suggests that delay adaptation and tracking skill could be two separate components of learning.
Collapse
Affiliation(s)
- Elie Cattan
- Univ. Grenoble Alpes, CNRS, Grenoble-INP, LIG, 38000, Grenoble, France
| | - Pascal Perrier
- Univ. Grenoble Alpes, CNRS, Grenoble-INP, Gipsa-Lab, 38000, Grenoble, France
| | - François Bérard
- Univ. Grenoble Alpes, CNRS, Grenoble-INP, LIG, 38000, Grenoble, France
| | - Silvain Gerber
- Univ. Grenoble Alpes, CNRS, Grenoble-INP, Gipsa-Lab, 38000, Grenoble, France
| | | |
Collapse
|
15
|
Castro-Meneses LJ, Sowman PF. Stop signals delay synchrony more for finger tapping than vocalization: a dual modality study of rhythmic synchronization in the stop signal task. PeerJ 2018; 6:e5242. [PMID: 30013856 PMCID: PMC6046193 DOI: 10.7717/peerj.5242] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 06/26/2018] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND A robust feature of sensorimotor synchronization (SMS) performance in finger tapping to an auditory pacing signal is the negative asynchrony of the tap with respect to the pacing signal. The Paillard-Fraisse hypothesis suggests that negative asynchrony is a result of inter-modal integration, in which the brain compares sensory information across two modalities (auditory and tactile). The current study compared the asynchronies of vocalizations and finger tapping in time to an auditory pacing signal. Our first hypothesis was that vocalizations have less negative asynchrony compared to finger tapping due to the requirement for sensory integration within only a single (auditory) modality (intra-modal integration). However, due to the different measurements for vocalizations and finger responses, interpreting the comparison between these two response modalities is problematic. To address this problem, we included stop signals in the synchronization task. The rationale for this manipulation was that stop signals would perturb synchronization more in the inter-modal compared to the intra-modal task. We hypothesized that the inclusion of stop signals induce proactive inhibition, which reduces negative asynchrony. We further hypothesized that any reduction in negative asynchrony occurs to a lesser degree for vocalization than for finger tapping. METHOD A total of 30 participants took part in this study. We compared SMS in a single sensory modality (vocalizations (or auditory) to auditory pacing signal) to a dual sensory modality (fingers (or tactile) to auditory pacing signal). The task was combined with a stop signal task in which stop signals were relevant in some blocks and irrelevant in others. Response-to-pacing signal asynchronies and stop signal reaction times were compared across modalities and across the two types of stop signal blocks. RESULTS In the blocks where stopping was irrelevant, we found that vocalization (-61.47 ms) was more synchronous with the auditory pacing signal compared to finger tapping (-128.29 ms). In the blocks where stopping was relevant, stop signals induced proactive inhibition, shifting the response times later. However, proactive inhibition (26.11 ms) was less evident for vocalizations compared to finger tapping (58.06 ms). DISCUSSION These results support the interpretation that relatively large negative asynchrony in finger tapping is a consequence of inter-modal integration, whereas smaller asynchrony is associated with intra-modal integration. This study also supports the interpretation that intra-modal integration is more sensitive to synchronization discrepancies compared to inter-modal integration.
Collapse
Affiliation(s)
- Leidy J. Castro-Meneses
- Perception in Action Research Centre (PARC), Department of Cognitive Science, Macquarie University, North Ryde, NSW, Australia
- Australian Research Council Centre of Excellence in Cognition and its Disorders (CCD), Macquarie University, North Ryde, NSW, Australia
- The MARCS Institute for Brain, Behaviour and Development, University of Western Sydney, Bankstown, NSW, Australia
| | - Paul F. Sowman
- Perception in Action Research Centre (PARC), Department of Cognitive Science, Macquarie University, North Ryde, NSW, Australia
- Australian Research Council Centre of Excellence in Cognition and its Disorders (CCD), Macquarie University, North Ryde, NSW, Australia
| |
Collapse
|
16
|
Sugano Y, Keetels M, Vroomen J. Audio-motor but not visuo-motor temporal recalibration speeds up sensory processing. PLoS One 2017; 12:e0189242. [PMID: 29216307 PMCID: PMC5720774 DOI: 10.1371/journal.pone.0189242] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2017] [Accepted: 11/24/2017] [Indexed: 11/18/2022] Open
Abstract
Perception of synchrony between one's own action (a finger tap) and the sensory feedback thereof (a visual flash or an auditory pip) can be recalibrated after exposure to an artificially inserted delay between them (temporal recalibration effect: TRE). TRE might be mediated by a compensatory shift of motor timing (when did I tap?) and/or the sensory timing of the feedback (when did I hear/see the feedback?). To examine this, we asked participants to voluntarily tap their index finger at a constant pace while receiving visual or auditory feedback (a flash or pip) that was either synced or somewhat delayed relative to the tap. Following this exposure phase, they then performed a simple reaction time (RT) task to measure the sensory timing of the exposure stimulus, and a sensorimotor synchronization (SMS) task (tapping in synchrony with a flash or pip as pacing stimulus) to measure the point of subjective synchrony between the tap and pacing stimulus. The results showed that after exposure to delayed auditory feedback, participants tapped earlier (~21.5 ms) relative to auditory pacing stimuli (= temporal recalibration) and reacted faster (~5.6 ms) to auditory stimuli. For visual exposure and test stimuli, there were no such compensatory effects. These results indicate that adjustments of audio-motor synchrony can to some extent be explained by a change in the speed of auditory sensory processing. We discuss this in terms of an attentional modulation of sensory processing.
Collapse
Affiliation(s)
- Yoshimori Sugano
- Department of Industrial Management, Kyushu Sangyo University, Fukuoka, Japan
- * E-mail: (YS); (JV)
| | - Mirjam Keetels
- Department of Cognitive Neuropsychology, Tilburg University, Tilburg, the Netherlands
| | - Jean Vroomen
- Department of Cognitive Neuropsychology, Tilburg University, Tilburg, the Netherlands
- * E-mail: (YS); (JV)
| |
Collapse
|
17
|
|
18
|
Tsujita M, Ichikawa M. Awareness of Temporal Lag is Necessary for Motor-Visual Temporal Recalibration. Front Integr Neurosci 2016; 9:64. [PMID: 26778983 PMCID: PMC4700206 DOI: 10.3389/fnint.2015.00064] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2015] [Accepted: 12/07/2015] [Indexed: 11/14/2022] Open
Abstract
Consistent exposure to a temporal lag between observers' voluntary action and its visual feedback induced recalibration of temporal order perception between a motor action and a visual stimulus. It remains unclear what kinds of processing underlie this motor–visual temporal recalibration. This study examined the necessity of awareness of a temporal lag between a motor action and its visual feedback for motor–visual temporal recalibration. In Experiment 1, we allocated observers to either the multiple-step or single-step lag conditions. In the multiple-step lag condition, we first inserted a small temporal lag and subsequently increased it with progress of the adaptation period, to make observers unaware of the temporal lag during the adaptation period. In the single-step lag condition, we instructed observers about the temporal lag before adaptation, and inserted a substantial temporal lag from the beginning of the adaptation period to ensure that they were aware of the temporal lag. We found significant recalibration only in the single-step lag condition. In Experiment 2, we exposed all observers to a substantial temporal lag from the beginning of adaptation period with no instruction about insertion of the temporal lag. We asked observers at the end of the experiment whether they were aware of the temporal lag. We found significant recalibration for only observers who were aware of the lag. These results suggest that awareness of the temporal lag plays a crucial role in motor–visual temporal recalibration.
Collapse
Affiliation(s)
- Masaki Tsujita
- Graduate School of Advanced Integration Science, Chiba UniversityChiba, Japan; Japan Society for the Promotion of ScienceTokyo, Japan
| | | |
Collapse
|
19
|
Kawabe T. Delayed Visual Feedback of One's Own Action Promotes Sense of Control for Auditory Events. Front Integr Neurosci 2015; 9:57. [PMID: 26635552 PMCID: PMC4652057 DOI: 10.3389/fnint.2015.00057] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2015] [Accepted: 10/30/2015] [Indexed: 11/13/2022] Open
Abstract
Sense of control refers to one’s feelings to control environmental events through one’s own action. A prevailing view is that the sense of control is strong (or is not diminished) when predicted sensory signals, which are generated in motor control mechanisms, are consistent with afferent sensory signals. Such intact sense of control often leads to the misjudgment of temporal relation between timings of one’s action and its effect (so-called, intentional binding). The present study showed that the intentional binding could be enhanced by the delayed visual feedback of an agent’s action. We asked participants to press a button to produce a tone as action outcome. In some conditions, they were given the delayed visual feedback of their button press. Participants judged whether the onset of the auditory outcome was delayed from the timing of their button press. Consequently, delay detection thresholds were significantly higher when the feedback was given 0.2 and 0.4 s delays than when no feedback was displayed to the participants. The results indicate that action agents misjudge the timing of their action (button press) in the presence of the delayed visual feedback of their action. Interestingly, delay detection thresholds were strongly correlated with the subjective magnitude of the sense of control. Thus, the sense of control is possibly determined by cross-modal processing for action-related and outcome-related sensory signals.
Collapse
Affiliation(s)
- Takahiro Kawabe
- Human Information Science Laboratory, NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation Atsugi, Japan
| |
Collapse
|
20
|
Time perception and the experience of agency. PSYCHOLOGICAL RESEARCH 2015; 80:286-97. [PMID: 25749800 DOI: 10.1007/s00426-015-0654-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2014] [Accepted: 02/17/2015] [Indexed: 10/23/2022]
Abstract
In the current study, we investigate whether sense of agency over an effect coincides with the perceived time of the effect that occurs either at its usual time or earlier or later than usual. One group of participants usually perceived an action effect immediately after the action, another group delayed by 250 ms. In test blocks the effect stimulus was sometimes presented earlier or later than usual. Participants judged either the degree of experienced agency over the effect or whether the effect had appeared at its usual time, or earlier or later than usual. In both groups experienced agency and the perception of the effect's time 'as usual' were highly correlated. To rule out that time judgments influenced sense of agency, we replicated the pattern of agency judgments in Experiment 2 in which participants only judged agency. Taken together, we demonstrated that agency and time judgments vary similarly across temporal deviations of effects irrespective of to which delay participants were adapted to. The high correlation of judgment types indicates that perceiving an effect at its usual time and sensing to have caused the effect are closely related. In contrast, physical temporal proximity of actions and effects has only a minor impact on experienced agency.
Collapse
|
21
|
The pre-reflective experience of “I” as a continuously existing being: The role of temporal functional binding. Conscious Cogn 2015; 31:98-114. [DOI: 10.1016/j.concog.2014.11.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2014] [Revised: 11/04/2014] [Accepted: 11/07/2014] [Indexed: 11/23/2022]
|
22
|
Recalibration of subjective simultaneity between self-generated movement and delayed auditory feedback. Neuroreport 2014; 25:284-8. [PMID: 24217393 DOI: 10.1097/wnr.0000000000000079] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Temporal contingency between motor commands and corresponding auditory feedback is crucial for perception of self-generated sound as well as external auditory events. The present study examined whether delay detection of self-generated sound was affected by the range of delayed auditory feedback used during the experiment. Participants pressed a button with their right index finger and judged whether auditory feedback was delayed compared with the sensation of finger movement. The range of auditory feedback delay was varied across conditions. To calculate the delay detection threshold (DDT), that is, the point at which the delay detection rate was 50%, we fitted a logistic function to the delay-detection probability curve. The DDT was significantly different across conditions (Tukey-Kramer's honestly significant difference test, P<0.01). Specifically, the DDT became longer as the mean delay of the range increased. However, this shift was not observed for the delay range with a minimum delay greater than 250 ms. We propose that the subjective simultaneity of auditory feedback and self-body movement is, to some extent, automatically recalibrated toward the mean delay of the delay range used in the experiment.
Collapse
|
23
|
Yamamoto K, Kawabata H. Adaptation to delayed auditory feedback induces the temporal recalibration effect in both speech perception and production. Exp Brain Res 2014; 232:3707-18. [PMID: 25106757 DOI: 10.1007/s00221-014-4055-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2014] [Accepted: 07/24/2014] [Indexed: 11/24/2022]
Abstract
We ordinarily speak fluently, even though our perceptions of our own voices are disrupted by various environmental acoustic properties. The underlying mechanism of speech is supposed to monitor the temporal relationship between speech production and the perception of auditory feedback, as suggested by a reduction in speech fluency when the speaker is exposed to delayed auditory feedback (DAF). While many studies have reported that DAF influences speech motor processing, its relationship to the temporal tuning effect on multimodal integration, or temporal recalibration, remains unclear. We investigated whether the temporal aspects of both speech perception and production change due to adaptation to the delay between the motor sensation and the auditory feedback. This is a well-used method of inducing temporal recalibration. Participants continually read texts with specific DAF times in order to adapt to the delay. Then, they judged the simultaneity between the motor sensation and the vocal feedback. We measured the rates of speech with which participants read the texts in both the exposure and re-exposure phases. We found that exposure to DAF changed both the rate of speech and the simultaneity judgment, that is, participants' speech gained fluency. Although we also found that a delay of 200 ms appeared to be most effective in decreasing the rates of speech and shifting the distribution on the simultaneity judgment, there was no correlation between these measurements. These findings suggest that both speech motor production and multimodal perception are adaptive to temporal lag but are processed in distinct ways.
Collapse
Affiliation(s)
- Kosuke Yamamoto
- Department of Psychology, Keio University, 2-15-45 Mita, Minato-ku, Tokyo, 108-8345, Japan
| | | |
Collapse
|
24
|
Cornelis H, Coop AD. Afference copy as a quantitative neurophysiological model for consciousness. J Integr Neurosci 2014; 13:363-402. [DOI: 10.1142/s0219635214400020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
25
|
Sugano Y, Keetels M, Vroomen J. Concurrent sensorimotor temporal recalibration to different lags for the left and right hand. Front Psychol 2014; 5:140. [PMID: 24624098 PMCID: PMC3934310 DOI: 10.3389/fpsyg.2014.00140] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2013] [Accepted: 02/03/2014] [Indexed: 11/22/2022] Open
Abstract
Perception of temporal synchrony between one’s own action and the sensory feedback of that action is quite flexible. We examined whether sensorimotor temporal recalibration (TR) involves central or motor-specific components by concurrently exposing the left and right hands to different lags. The experiment was composed of a pre-test, an adaptation phase, and a post-test. During the adaptation phase, participants tapped their left and right index fingers in alternating fashion while each tap induced an auditory feedback signal (a short click sound). One hand was exposed to a long delay between the tap and the sound (~150 ms), while the other hand was exposed to a subjective no-delay (~50 ms). Before and after the adaptation phase (the pre- and post-test), participants tried to tap in synchrony with pacer tones (ISI = 1000 ms). The results showed that the hand that was exposed to the delayed sound corrected for this delay by tapping earlier (a larger anticipation error) than the no-delay hand, indicating TR. Different amounts of TR were found when the left and right hand were concurrently exposed to the same versus different delays. With different exposure- delays for the two hands, there was a TR even for the hand that did not experience any delay in the feedback signal. However, it is not the case with the same exposure delay for the two hands. TR of the hand that experienced delayed feedback also occurred faster and was more complete (~40% greater than that of the hand with no subjective delay) if the two hands were exposed to the same rather than different delays (~20% greater than that of the hand with no subjective delay). These results suggest the existence of cross-talk between the hands, where both central and motor-specific components might be involved.
Collapse
Affiliation(s)
- Yoshimori Sugano
- Department of Industrial Management, Kyushu Sangyo University Fukuoka, Japan
| | - Mirjam Keetels
- Department of Cognitive Neuropsychology, Tilburg University Tilburg, Netherlands
| | - Jean Vroomen
- Department of Cognitive Neuropsychology, Tilburg University Tilburg, Netherlands
| |
Collapse
|
26
|
Abstract
One of the oldest models of schizophrenia is based on the effects of serotonergic hallucinogens such as mescaline, psilocybin, and (+)-lysergic acid diethylamide (LSD), which act through the serotonin 5-HT(2A) receptor. These compounds produce a 'model psychosis' in normal individuals that resembles at least some of the positive symptoms of schizophrenia. Based on these similarities, and because evidence has emerged that the serotonergic system plays a role in the pathogenesis of schizophrenia in some patients, animal models relevant to schizophrenia have been developed based on hallucinogen effects. Here we review the behavioural effects of hallucinogens in four of those models, the receptor and neurochemical mechanisms for the effects and their translational relevance. Despite the difficulty of modelling hallucinogen effects in nonverbal species, animal models of schizophrenia based on hallucinogens have yielded important insights into the linkage between 5-HT and schizophrenia and have helped to identify receptor targets and interactions that could be exploited in the development of new therapeutic agents.
Collapse
|
27
|
Kawabe T, Roseboom W, Nishida S. The sense of agency is action-effect causality perception based on cross-modal grouping. Proc Biol Sci 2013; 280:20130991. [PMID: 23740784 DOI: 10.1098/rspb.2013.0991] [Citation(s) in RCA: 57] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Sense of agency, the experience of controlling external events through one's actions, stems from contiguity between action- and effect-related signals. Here we show that human observers link their action- and effect-related signals using a computational principle common to cross-modal sensory grouping. We first report that the detection of a delay between tactile and visual stimuli is enhanced when both stimuli are synchronized with separate auditory stimuli (experiment 1). This occurs because the synchronized auditory stimuli hinder the potential grouping between tactile and visual stimuli. We subsequently demonstrate an analogous effect on observers' key press as an action and a sensory event. This change is associated with a modulation in sense of agency; namely, sense of agency, as evaluated by apparent compressions of action-effect intervals (intentional binding) or subjective causality ratings, is impaired when both participant's action and its putative visual effect events are synchronized with auditory tones (experiments 2 and 3). Moreover, a similar role of action-effect grouping in determining sense of agency is demonstrated when the additional signal is presented in the modality identical to an effect event (experiment 4). These results are consistent with the view that sense of agency is the result of general processes of causal perception and that cross-modal grouping plays a central role in these processes.
Collapse
Affiliation(s)
- Takahiro Kawabe
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, 3-1, Morinosato Wakamiya, Atsugi 243-0198, Kanagawa, Japan.
| | | | | |
Collapse
|
28
|
Botzer L, Karniel A. Feedback and feedforward adaptation to visuomotor delay during reaching and slicing movements. Eur J Neurosci 2013; 38:2108-23. [DOI: 10.1111/ejn.12211] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2012] [Revised: 02/24/2013] [Accepted: 03/02/2013] [Indexed: 11/29/2022]
Affiliation(s)
- Lior Botzer
- Department of Biomedical Engineering; Ben-Gurion University of the Negev; Room 229; Building 51; Beer Sheva; Israel
| | - Amir Karniel
- Department of Biomedical Engineering; Ben-Gurion University of the Negev; Room 229; Building 51; Beer Sheva; Israel
| |
Collapse
|
29
|
Kambara H, Shin D, Kawase T, Yoshimura N, Akahane K, Sato M, Koike Y. The effect of temporal perception on weight perception. Front Psychol 2013; 4:40. [PMID: 23450805 PMCID: PMC3584255 DOI: 10.3389/fpsyg.2013.00040] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2012] [Accepted: 01/16/2013] [Indexed: 11/26/2022] Open
Abstract
A successful catch of a falling ball requires an accurate estimation of the timing for when the ball hits the hand. In a previous experiment in which participants performed ball-catching task in virtual reality environment, we accidentally found that the weight of a falling ball was perceived differently when the timing of ball load force to the hand was shifted from the timing expected from visual information. Although it is well known that spatial information of an object, such as size, can easily deceive our perception of its heaviness, the relationship between temporal information and perceived heaviness is still not clear. In this study, we investigated the effect of temporal factors on weight perception. We conducted ball-catching experiments in a virtual environment where the timing of load force exertion was shifted away from the visual contact timing (i.e., time when the ball hit the hand in the display). We found that the ball was perceived heavier when force was applied earlier than visual contact and lighter when force was applied after visual contact. We also conducted additional experiments in which participants were conditioned to one of two constant time offsets prior to testing weight perception. After performing ball-catching trials with 60 ms advanced or delayed load force exertion, participants’ subjective judgment on the simultaneity of visual contact and force exertion changed, reflecting a shift in perception of time offset. In addition, timing of catching motion initiation relative to visual contact changed, reflecting a shift in estimation of force timing. We also found that participants began to perceive the ball as lighter after conditioning to 60 ms advanced offset and heavier after the 60 ms delayed offset. These results suggest that perceived heaviness depends not on the actual time offset between force exertion and visual contact but on the subjectively perceived time offset between them and/or estimation error in force timing.
Collapse
Affiliation(s)
- Hiroyuki Kambara
- Precision and Intelligence Laboratory, Tokyo Institute of Technology Yokohama, Japan
| | | | | | | | | | | | | |
Collapse
|
30
|
Parsons BD, Novich SD, Eagleman DM. Motor-sensory recalibration modulates perceived simultaneity of cross-modal events at different distances. Front Psychol 2013; 4:46. [PMID: 23549660 PMCID: PMC3582016 DOI: 10.3389/fpsyg.2013.00046] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2012] [Accepted: 01/22/2013] [Indexed: 11/13/2022] Open
Abstract
A popular model for the representation of time in the brain posits the existence of a single, central-clock. In that framework, temporal distortions in perception are explained by contracting or expanding time over a given interval. We here present evidence for an alternative account, one which proposes multiple independent timelines coexisting within the brain and stresses the importance of motor predictions and causal inferences in constructing our temporal representation of the world. Participants judged the simultaneity of a beep and flash coming from a single source at different distances. The beep was always presented at a constant delay after a motor action, while the flash occurred at a variable delay. Independent shifts in the implied timing of the auditory stimulus toward the motor action (but not the visual stimulus) provided evidence against a central-clock model. Additionally, the hypothesis that the time between action and delayed effect is compressed (known as intentional binding) seems unable to explain our results: firstly, because actions and effects can perceptually reverse, and secondly because the recalibration of simultaneity remains even after the participant's intentional actions are no longer present. Contrary to previous reports, we also find that participants are unable to use distance cues to compensate for the relatively slower speed of sound when audio-visual events are presented in depth. When a motor act is used to control the distal event, however, adaptation to the delayed auditory signal occurs and subjective cross-sensory synchrony is maintained. These results support the hypothesis that perceptual timing derives from and is calibrated by our motor interactions with the world.
Collapse
Affiliation(s)
- Brent D Parsons
- Department of Neuroscience, Baylor College of Medicine Houston, TX, USA
| | | | | |
Collapse
|
31
|
Rohde M, Ernst MO. To lead and to lag - forward and backward recalibration of perceived visuo-motor simultaneity. Front Psychol 2013; 3:599. [PMID: 23346063 PMCID: PMC3551234 DOI: 10.3389/fpsyg.2012.00599] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2012] [Accepted: 12/18/2012] [Indexed: 12/02/2022] Open
Abstract
Studies on human recalibration of perceived visuo-motor simultaneity so far have been limited to the study of recalibration to movement-lead temporal discrepancies (visual lags). We studied adaptation to both vision-lead and movement-lead discrepancies, to test for differences between these conditions, as a leading visual stimulus violates the underlying cause-effect structure. To this end, we manipulated the temporal relationship between a motor action (button press) and a visual event (flashed disk) in a training phase. Participants were tested in a temporal order judgment task and perceived simultaneity (PSS) was compared before and after recalibration. A PHANToM©force-feedback device that tracks the finger position in real time was used to display a virtual button. We predicted the timing of full compression of the button from early movement onset in order to time visual stimuli even before the movement event of the full button press. The results show that recalibration of perceived visuo-motor simultaneity is evident in both directions and does not differ in magnitude between the conditions. The strength of recalibration decreases with perceptual accuracy, suggesting the possibility that some participants recalibrate less because they detect the discrepancy. We conclude that the mechanisms of temporal recalibration work in both directions and that there is no evidence that they are asymmetrical around the point of actual simultaneity, despite the underlying asymmetry in the cause-effect relation.
Collapse
Affiliation(s)
- Marieke Rohde
- Department of Cognitive Neurosciences, University of Bielefeld Bielefeld, Germany ; Cognitive Interaction Technology Centre of Excellence, University of Bielefeld Bielefeld, Germany
| | | |
Collapse
|
32
|
Tanaka H, Homma K, Imamizu H. Illusory Reversal of Causality between Touch and Vision has No Effect on Prism Adaptation Rate. Front Psychol 2012; 3:545. [PMID: 23248609 PMCID: PMC3518875 DOI: 10.3389/fpsyg.2012.00545] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2012] [Accepted: 11/16/2012] [Indexed: 12/02/2022] Open
Abstract
Learning, according to Oxford Dictionary, is “to gain knowledge or skill by studying, from experience, from being taught, etc.” In order to learn from experience, the central nervous system has to decide what action leads to what consequence, and temporal perception plays a critical role in determining the causality between actions and consequences. In motor adaptation, causality between action and consequence is implicitly assumed so that a subject adapts to a new environment based on the consequence caused by her action. Adaptation to visual displacement induced by prisms is a prime example; the visual error signal associated with the motor output contributes to the recovery of accurate reaching, and a delayed feedback of visual error can decrease the adaptation rate. Subjective feeling of temporal order of action and consequence, however, can be modified or even reversed when her sense of simultaneity is manipulated with an artificially delayed feedback. Our previous study (Tanaka et al., 2011; Exp. Brain Res.) demonstrated that the rate of prism adaptation was unaffected when the subjective delay of visual feedback was shortened. This study asked whether subjects could adapt to prism adaptation and whether the rate of prism adaptation was affected when the subjective temporal order was illusory reversed. Adapting to additional 100 ms delay and its sudden removal caused a positive shift of point of simultaneity in a temporal order judgment experiment, indicating an illusory reversal of action and consequence. We found that, even in this case, the subjects were able to adapt to prism displacement with the learning rate that was statistically indistinguishable to that without temporal adaptation. This result provides further evidence to the dissociation between conscious temporal perception and motor adaptation.
Collapse
Affiliation(s)
- Hirokazu Tanaka
- School of Information Science, Japan Advanced Institute of Science and Technology Nomi, Ishikawa, Japan
| | | | | |
Collapse
|
33
|
Acerbi L, Wolpert DM, Vijayakumar S. Internal representations of temporal statistics and feedback calibrate motor-sensory interval timing. PLoS Comput Biol 2012; 8:e1002771. [PMID: 23209386 PMCID: PMC3510049 DOI: 10.1371/journal.pcbi.1002771] [Citation(s) in RCA: 113] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2012] [Accepted: 09/24/2012] [Indexed: 12/22/2022] Open
Abstract
Humans have been shown to adapt to the temporal statistics of timing tasks so as to optimize the accuracy of their responses, in agreement with the predictions of Bayesian integration. This suggests that they build an internal representation of both the experimentally imposed distribution of time intervals (the prior) and of the error (the loss function). The responses of a Bayesian ideal observer depend crucially on these internal representations, which have only been previously studied for simple distributions. To study the nature of these representations we asked subjects to reproduce time intervals drawn from underlying temporal distributions of varying complexity, from uniform to highly skewed or bimodal while also varying the error mapping that determined the performance feedback. Interval reproduction times were affected by both the distribution and feedback, in good agreement with a performance-optimizing Bayesian observer and actor model. Bayesian model comparison highlighted that subjects were integrating the provided feedback and represented the experimental distribution with a smoothed approximation. A nonparametric reconstruction of the subjective priors from the data shows that they are generally in agreement with the true distributions up to third-order moments, but with systematically heavier tails. In particular, higher-order statistical features (kurtosis, multimodality) seem much harder to acquire. Our findings suggest that humans have only minor constraints on learning lower-order statistical properties of unimodal (including peaked and skewed) distributions of time intervals under the guidance of corrective feedback, and that their behavior is well explained by Bayesian decision theory. Human performance in a timing task depends on the context of recently experienced time intervals. In fact, people may use prior experience to improve their timing performance. Given the relevance of time for both sensing and acting in the world, how humans learn and represent temporal information is a fundamental question in neuroscience. Here, we ask subjects to reproduce the duration of time intervals drawn from different distributions (different temporal contexts). We build a set of models of how people might behave in such a timing task, depending on how they are representing the temporal context. Comparison between models and data allows us to establish that in general subjects are integrating task-relevant temporal information with the provided error feedback to enhance their timing performance. Analysis of the subjects' responses allows us to reconstruct their internal representation of the temporal context, and we compare it with the true distribution. We find that with the help of corrective feedback humans can learn good approximations of unimodal distributions of time intervals used in the experiment, even for skewed distributions of durations; on the other hand, under similar conditions, we find that multimodal distributions of timing intervals are much harder to acquire.
Collapse
Affiliation(s)
- Luigi Acerbi
- Institute of Perception, Action and Behaviour, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom.
| | | | | |
Collapse
|
34
|
Cai M, Stetson C, Eagleman DM. A neural model for temporal order judgments and their active recalibration: a common mechanism for space and time? Front Psychol 2012; 3:470. [PMID: 23130010 PMCID: PMC3487422 DOI: 10.3389/fpsyg.2012.00470] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2012] [Accepted: 10/15/2012] [Indexed: 11/13/2022] Open
Abstract
When observers experience a constant delay between their motor actions and sensory feedback, their perception of the temporal order between actions and sensations adapt (Stetson et al., 2006). We present here a novel neural model that can explain temporal order judgments (TOJs) and their recalibration. Our model employs three ubiquitous features of neural systems: (1) information pooling, (2) opponent processing, and (3) synaptic scaling. Specifically, the model proposes that different populations of neurons encode different delays between motor-sensory events, the outputs of these populations feed into rivaling neural populations (encoding "before" and "after"), and the activity difference between these populations determines the perceptual judgment. As a consequence of synaptic scaling of input weights, motor acts which are consistently followed by delayed sensory feedback will cause the network to recalibrate its point of subjective simultaneity. The structure of our model raises the possibility that recalibration of TOJs is a temporal analog to the motion aftereffect (MAE). In other words, identical neural mechanisms may be used to make perceptual determinations about both space and time. Our model captures behavioral recalibration results for different numbers of adapting trials and different adapting delays. In line with predictions of the model, we additionally demonstrate that temporal recalibration can last through time, in analogy to storage of the MAE.
Collapse
Affiliation(s)
- Mingbo Cai
- Department of Neuroscience, Baylor College of MedicineHouston, TX, USA
| | - Chess Stetson
- Department of Neuroscience, California Institute of TechnologyPasadena, CA, USA
| | - David M. Eagleman
- Department of Neuroscience, Baylor College of MedicineHouston, TX, USA
- Department of Psychiatry, Baylor College of MedicineHouston, TX, USA
| |
Collapse
|
35
|
Ganzenmüller S, Shi Z, Müller HJ. Duration reproduction with sensory feedback delay: differential involvement of perception and action time. Front Integr Neurosci 2012; 6:95. [PMID: 23087628 PMCID: PMC3472406 DOI: 10.3389/fnint.2012.00095] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2012] [Accepted: 09/27/2012] [Indexed: 11/13/2022] Open
Abstract
Previous research has shown that voluntary action can attract subsequent, delayed feedback events toward the action, and adaptation to the sensorimotor delay can even reverse motor-sensory temporal order judgments. However, whether and how sensorimotor delay affects duration reproduction is still unclear. To investigate this, we injected an onset- or offset-delay to the sensory feedback signal from a duration reproduction task. We compared duration reproductions within (visual, auditory) modality and across audiovisual modalities with feedback signal onset- and offset-delay manipulations. We found that the reproduced duration was lengthened in both visual and auditory feedback signal onset-delay conditions. The lengthening effect was evident immediately, on the first trial with the onset-delay. However, when the onset of the feedback signal was prior to the action, the lengthening effect was diminished. In contrast, a shortening effect was found with feedback signal offset-delay, though the effect was weaker and manifested only in the auditory offset-delay condition. These findings indicate that participants tend to mix the onset of action and the feedback signal more when the feedback is delayed, and they heavily rely on motor-stop signals for the duration reproduction. Furthermore, auditory duration was overestimated compared to visual duration in crossmodal feedback conditions, and the overestimation of auditory duration (or the underestimation of visual duration) was independent of the delay manipulation.
Collapse
Affiliation(s)
- Stephanie Ganzenmüller
- Department Psychology, General and Experimental Psychology LMU Munich, Germany ; Graduate School of Systemic Neuroscience LMU Munich, Germany
| | | | | |
Collapse
|
36
|
Sugano Y, Keetels M, Vroomen J. The Build-Up and Transfer of Sensorimotor Temporal Recalibration Measured via a Synchronization Task. Front Psychol 2012; 3:246. [PMID: 22807921 PMCID: PMC3395050 DOI: 10.3389/fpsyg.2012.00246] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2012] [Accepted: 06/25/2012] [Indexed: 11/13/2022] Open
Abstract
The timing relation between a motor action and the sensory consequences of that action can be adapted by exposing participants to artificially delayed feedback (temporal recalibration). Here, we demonstrate that a sensorimotor synchronization task (i.e., tapping the index finger in synchrony with a pacing signal) can be used as a measure of temporal recalibration. Participants were first exposed to a constant delay (~150 ms) between a voluntary action (a finger tap) and an external feedback stimulus of that action (a visual flash or auditory tone). A subjective "no-delay" condition (~50 ms) served as baseline. After a short exposure phase to delayed feedback participants performed the tapping task in which they tapped their finger in synchrony with a flash or tone. Temporal recalibration manifested itself in that taps were given ~20 ms earlier after exposure to 150 ms delays than in the case of 50 ms delays. This effect quickly built up (within 60 taps) and was bigger for auditory than visual adapters. In Experiment 2, we tested whether temporal recalibration would transfer across modalities by switching the modality of the adapter and pacing signal. Temporal recalibration transferred from visual adapter to auditory test, but not from auditory adapter to visual test. This asymmetric transfer suggests that sensory-specific effects are at play.
Collapse
|
37
|
Keetels M, Vroomen J. Exposure to delayed visual feedback of the hand changes motor-sensory synchrony perception. Exp Brain Res 2012; 219:431-40. [PMID: 22623088 PMCID: PMC3366181 DOI: 10.1007/s00221-012-3081-0] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2011] [Accepted: 03/18/2012] [Indexed: 11/30/2022]
Abstract
We examined whether the brain can adapt to temporal delays between a self-initiated action and the naturalistic visual feedback of that action. During an exposure phase, participants tapped with their index finger while seeing their own hand in real time (~0 ms delay) or delayed at 40, 80, or 120 ms. Following exposure, participants were tested with a simultaneity judgment (SJ) task in which they judged whether the video of their hand was synchronous or asynchronous with respect to their finger taps. The locations of the seen and the real hand were either different (Experiment 1) or aligned (Experiment 2). In both cases, the point of subjective simultaneity (PSS) was uniformly shifted in the direction of the exposure lags while sensitivity to visual-motor asynchrony decreased with longer exposure delays. These findings demonstrate that the brain is quite flexible in adjusting the timing relation between a motor action and the otherwise naturalistic visual feedback that this action engenders.
Collapse
Affiliation(s)
- Mirjam Keetels
- Department of Medical Psychology and Neuropsychology, Tilburg University, Tilburg, The Netherlands.
| | | |
Collapse
|
38
|
Fujisaki W. Effects of delayed visual feedback on grooved pegboard test performance. Front Psychol 2012; 3:61. [PMID: 22408631 PMCID: PMC3297075 DOI: 10.3389/fpsyg.2012.00061] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2011] [Accepted: 02/15/2012] [Indexed: 11/25/2022] Open
Abstract
Using four experiments, this study investigates what amount of delay brings about maximal impairment under delayed visual feedback and whether a critical interval, such as that in audition, also exists in vision. The first experiment measured the Grooved Pegboard test performance as a function of visual feedback delays from 120 to 2120 ms in 16 steps. Performance sharply decreased until about 490 ms, then more gradually until 2120 ms, suggesting that two mechanisms were operating under delayed visual feedback. Since delayed visual feedback differs from delayed auditory feedback in that the former induces not only temporal but also spatial displacements between motor and sensory feedback, this difference could also exist in the mechanism responsible for spatial displacement. The second experiment was hence conducted to provide simultaneous haptic feedback together with delayed visual feedback to inform correct spatial position. The disruption was significantly ameliorated when information about spatial position was provided from a haptic source. The sharp decrease in performance of up to approximately 300 ms was followed by an almost flat performance. This is similar to the critical interval found in audition. Accordingly, the mechanism that caused the sharp decrease in performance in experiments 1 and 2 was probably mainly responsible for temporal disparity and is common across different modality–motor combinations, while the other mechanism that caused a rather gradual decrease in performance in experiment 1 was mainly responsible for spatial displacement. In experiments 3 and 4, the reliability of spatial information from the haptic source was reduced by wearing a glove or using a tool. When the reliability of spatial information was reduced, the data lay between those of experiments 1 and 2, and that a gradual decrease in performance partially reappeared. These results further support the notion that two mechanisms operate under delayed visual feedback.
Collapse
Affiliation(s)
- Waka Fujisaki
- Human Technology Research Institute, National Institute of Advanced Industrial Science and Technology Tsukuba, Ibaraki, Japan
| |
Collapse
|
39
|
Watanabe M, Shinohara S, Shimojo S. Mirror adaptation in sensory-motor simultaneity. PLoS One 2011; 6:e28080. [PMID: 22205937 PMCID: PMC3244384 DOI: 10.1371/journal.pone.0028080] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2010] [Accepted: 10/31/2011] [Indexed: 11/22/2022] Open
Abstract
Background When one watches a sports game, one may feel her/his own muscles moving in synchrony with the player's. Such parallels between observed actions of others and one's own has been well supported in the latest progress in neuroscience, and coined “mirror system.” It is likely that due to such phenomena, we are able to learn motor skills just by observing an expert's performance. Yet it is unknown whether such indirect learning occurs only at higher cognitive levels, or also at basic sensorimotor levels where sensorimotor delay is compensated and the timing of sensory feedback is constantly calibrated. Methodology/Principal Findings Here, we show that the subject's passive observation of an actor manipulating a computer mouse with delayed auditory feedback led to shifts in subjective simultaneity of self mouse manipulation and auditory stimulus in the observing subjects. Likewise, self adaptation to the delayed feedback modulated the simultaneity judgment of the other subjects manipulating a mouse and an auditory stimulus. Meanwhile, subjective simultaneity of a simple visual disc and the auditory stimulus (flash test) was not affected by observation of an actor nor self-adaptation. Conclusions/Significance The lack of shift in the flash test for both conditions indicates that the recalibration transfer is specific to the action domain, and is not due to a general sensory adaptation. This points to the involvement of a system for the temporal monitoring of actions, one that processes both one's own actions and those of others.
Collapse
Affiliation(s)
- Masataka Watanabe
- School of Engineering, University of Tokyo, Bunkyo-ku, Tokyo, Japan.
| | | | | |
Collapse
|
40
|
Gorea A. Ticks per thought or thoughts per tick? A selective review of time perception with hints on future research. ACTA ACUST UNITED AC 2011; 105:153-63. [PMID: 21963529 DOI: 10.1016/j.jphysparis.2011.09.008] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
The last decade underwent a revival of interest in the perception of time and duration. The present short essay does not compete with the many other recent reviews and books on this topic. Instead, it is meant to emphasize the notion that humans (and most likely other animals) have at their disposal more than one time measuring device and to propose that they use these devices jointly to appraise the passage of time. One possible consequence of this conjecture is that the same physical duration can be judged differently depending on the reference 'clock' used in any such judgment. As this view has not yet been tested empirically, several experimental manipulations susceptible to directly test it are suggested. Before, are summarized a number of its latent precursors, namely the relativity of perceived duration, current trends in modeling time perception and its neural and pharmacological substrate, the experimental literature supporting the existence of multiple 'clocks' and a selected number of experimental manipulations known to induce time perception illusions which together with many others are putatively accountable in terms of alternative clock readings.
Collapse
Affiliation(s)
- Andrei Gorea
- Laboratoire Psychologie de la Perception, Université Paris Descartes-Sorbonne Paris Cité and CNRS, 45 rue des Saints Pères, 75006 Paris, France.
| |
Collapse
|
41
|
Stekelenburg JJ, Sugano Y, Vroomen J. Neural correlates of motor-sensory temporal recalibration. Brain Res 2011; 1397:46-54. [PMID: 21600564 DOI: 10.1016/j.brainres.2011.04.045] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2010] [Revised: 03/03/2011] [Accepted: 04/24/2011] [Indexed: 11/29/2022]
Abstract
The relative timing of a motor-sensory event can be recalibrated after exposure to delayed visual feedback. Here we examined the neural consequences of lag adaptation using event-related potentials (ERPs). Participants tapped their finger on a pad, which triggered a flash either after a short delay (0 ms/50 ms) or a long delay (100 ms/150 ms). Following the exposure phase, they judged the temporal order of a synchronous tap-flash test stimulus. The synchronous flash was more often perceived to occur before the tap after exposure to long than short delays, indicating that the temporal relation between the tap and the flash was realigned. ERPs evoked by the synchronous tap-flash test stimulus showed that adaptation to delayed flashes caused an early attenuation of the visual P1 (85 ms-150 ms), and a later negativity at central electrodes (N450). The P1-attenuation may reflect the unexpected earliness of the test flash, or a violation of "cause-before-consequence". The N450 may be due to realignment of the adapted and the actual timing of the tap-flash interval. We conclude that motor-visual temporal recalibration has consequences at early perceptual levels of visual processing and involves a high-level recalibration mechanism.
Collapse
|
42
|
Tanaka H, Homma K, Imamizu H. Physical delay but not subjective delay determines learning rate in prism adaptation. Exp Brain Res 2010; 208:257-68. [PMID: 21076819 DOI: 10.1007/s00221-010-2476-z] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2010] [Accepted: 10/25/2010] [Indexed: 11/26/2022]
Abstract
Timing is critical in determining the causal relationship between two events. Motor adaptation relies on the timing of actions and their results for determining which preceding control signals were responsible for subsequent error in the resulting movements. An artificially induced temporal delay in error feedback as short as 50 ms has been found to slow the learning rate of prism adaptation. Recent studies have demonstrated that our sense of simultaneity is flexibly adaptive when a persistent delay is inserted into visual feedback timing of one's own action. Therefore, judgments of "subjective simultaneity" (i.e. whether two events are simultaneous on a subjective basis) do not necessarily correspond to the actual simultaneity of physical events. We evaluated the effects of adaptation to a temporal shift of subjective simultaneity on prism adaptation by examining whether prism adaptation depends on physical timing or subjective timing. We found that after persistently experiencing an additional 100-ms delay in a pointing experiment, psychometric curves of the timing of judgments about the temporal order of touching and visual feedback were shifted by 40 ms, indicating that subjective simultaneity adapted. Next, while maintaining temporal adaptation, participants adapted to spatial displacement caused by a prism with and without an additional temporal delay in feedback. Learning speed was reliably predicted by physical timing but not by subjective timing. These results indicate that prism adaptation occurs independently of awareness of subjective timing and may be processed in primary motor areas that are thought to have fidelity with temporal relations.
Collapse
Affiliation(s)
- Hirokazu Tanaka
- National Institute of Information and Communications Technology (NiCT), Hikaridai 2-2-2, Keihanna Science City, Kyoto 619-0288, Japan
| | | | | |
Collapse
|
43
|
Humphreys GR, Buehner MJ. Temporal binding of action and effect in interval reproduction. Exp Brain Res 2010; 203:465-70. [PMID: 20440611 DOI: 10.1007/s00221-010-2199-1] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2009] [Accepted: 02/15/2010] [Indexed: 10/19/2022]
|
44
|
Effect before cause: supramodal recalibration of sensorimotor timing. PLoS One 2009; 4:e7681. [PMID: 19890383 PMCID: PMC2766625 DOI: 10.1371/journal.pone.0007681] [Citation(s) in RCA: 64] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2009] [Accepted: 09/29/2009] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Our motor actions normally generate sensory events, but how do we know which events were self generated and which have external causes? Here we use temporal adaptation to investigate the processing stage and generality of our sensorimotor timing estimates. METHODOLOGY/PRINCIPAL FINDINGS Adaptation to artificially-induced delays between action and event can produce a startling percept--upon removal of the delay it feels as if the sensory event precedes its causative action. This temporal recalibration of action and event occurs in a quantitatively similar manner across the sensory modalities. Critically, it is robust to the replacement of one sense during the adaptation phase with another sense during the test judgment. CONCLUSIONS/SIGNIFICANCE Our findings suggest a high-level, supramodal recalibration mechanism. The effects are well described by a simple model which attempts to preserve the expected synchrony between action and event, but only when causality indicates it is reasonable to do so. We further demonstrate that this model successfully characterises related adaptation data from outside the sensorimotor domain.
Collapse
|
45
|
Sugano Y, Keetels M, Vroomen J. Adaptation to motor-visual and motor-auditory temporal lags transfer across modalities. Exp Brain Res 2009; 201:393-9. [PMID: 19851760 PMCID: PMC2832876 DOI: 10.1007/s00221-009-2047-3] [Citation(s) in RCA: 56] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2009] [Accepted: 10/05/2009] [Indexed: 11/26/2022]
Abstract
Previous research has shown that the timing of a sensor-motor event is recalibrated after a brief exposure to a delayed feedback of a voluntary action (Stetson et al. 2006). Here, we examined whether it is the sensory or motor event that is shifted in time. We compared lag adaption for action-feedback in visuo-motor pairs and audio-motor pairs using an adaptation-test paradigm. Participants were exposed to a constant lag (50 or 150 ms) between their voluntary action (finger tap) and its sensory feedback (flash or tone pip) during an adaptation period (approximately 3 min). Immediately after that, they performed a temporal order judgment (TOJ) task about the tap-feedback test stimulus pairings. The modality of the feedback stimulus was either the same as the adapted one (within-modal) or different (cross-modal). The results showed that the point of subjective simultaneity (PSS) was uniformly shifted in the direction of the exposed lag within and across modalities (motor-visual, motor-auditory). This suggests that the TRE of sensor-motor events is mainly caused by a shift in the motor component.
Collapse
Affiliation(s)
- Yoshimori Sugano
- Department of Psychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands
- Faculty of Management, Kyusyu Sangyo University, 3-1 Matsukadai 2-Chome Higashi-ku, Fukuoka, 813-8503 Japan
| | - Mirjam Keetels
- Department of Psychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands
| | - Jean Vroomen
- Department of Psychology, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands
| |
Collapse
|
46
|
|
47
|
Winter R, Harrar V, Gozdzik M, Harris LR. The relative timing of active and passive touch. Brain Res 2008; 1242:54-8. [PMID: 18634764 DOI: 10.1016/j.brainres.2008.06.090] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2008] [Revised: 06/04/2008] [Accepted: 06/20/2008] [Indexed: 10/21/2022]
Abstract
Tactile stimulation usually occurs as a combination of an active movement (reaching out to touch a surface) and a sensation (actually feeling the surface against the skin). The brain has information about the active component (the motor command) before it occurs because of efference copy, while the passive component must be transduced before it can be processed. Since the active and passive tactile components are available to the brain at different times, determining the time of touch requires calculation worked backwards from the passive sensation, and/or worked forward from the active motor command. In order to determine which touch process is perceived more quickly, we varied the relative delay between an active and a passive touch signal and determined the relative time perceived as simultaneous. A passive touch needed to be presented before an active key was pressed in order for the two touches to be perceived as simultaneous, but this timing difference was not significant. In order to test the plasticity of the active and passive touch systems, we exploited the fact that the point of subjective simultaneity between two stimuli can sometimes be altered by repeated exposure to asynchronous presentation. We exposed subjects to an active key press/ passive touch pair delayed by 250 ms. This exposure increased the range of relative delays between active and passive touches at which the pairs were judged as simultaneous. This is consistent with an adaptive change in the processing of active touch.
Collapse
Affiliation(s)
- Rebecca Winter
- Centre for Vision Research, York University, Toronto, Ontario, Canada.
| | | | | | | |
Collapse
|
48
|
Abstract
AbstractAlthough prediction is one of the key tasks of intelligent brains, it often proves impossible in an unpredictably changing world. Hence, brains often decide what happened retrospectively. This framework of postdiction, the opposite of prediction, stands as an alternative or complimentary framework to prediction. I further show how motor-sensory recalibration demonstrates delay compensation at the perceptual level.
Collapse
|
49
|
Kennedy JS, Buehner MJ, Rushton SK. Adaptation to sensory-motor temporal misalignment: instrumental or perceptual learning? Q J Exp Psychol (Hove) 2008; 62:453-69. [PMID: 18609410 DOI: 10.1080/17470210801985235] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Sensory-motor delays vary over the course of development and under different environmental conditions. Previous research has shown that humans can compensate for the resulting temporal misalignment while performing sensory-motor tasks (e.g., Cunningham, Billock, & Tsou, 2001a), but remains silent on the question of whether perceptual learning-similar to that involved in adaptation to spatial misalignment (e.g., Redding & Wallace, 1993) and in adaptation to purely intersensory misalignment (e.g., Fujisaki, Shimojo, Kashino, & Nishida, 2004)-is also involved in this adaptive response. Following an attempted replication of Cunningham et al.'s (2001a) study in a preliminary experiment, we present in this paper two experiments that demonstrate that after-effects of adaptation to temporal misalignment do not spontaneously decay. The literature on adaptation to spatial misalignment suggests that, while instrumental learning spontaneously decays in the absence of reinforcement, perceptual learning persists. Therefore our results are consistent with adaptation being effected through perceptual learning.
Collapse
Affiliation(s)
- Jon S Kennedy
- School of Psychology, Cardiff University, Cardiff, UK.
| | | | | |
Collapse
|
50
|
Visual prediction as indicated by perceptual adaptation to temporal delays and discrete stimulation. Behav Brain Sci 2008. [DOI: 10.1017/s0140525x08003865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractAnalogous to prism adaptation, sensorimotor compensation for existing neural delays has been clearly demonstrated. This system can also adapt to new delays, both internal and external. This seems to occur at least partially in the sensor systems, and works for discrete, stationary events. This provides additional evidence for visual prediction, but not in a manner that is consistent with spatial extrapolation.
Collapse
|