Multi-scale control influences sense of agency: Investigating intentional binding using event-control approach

Sense of Agency and Skills Learning in Virtual-Mediated Environment: A Systematic Review

Agency is central to remote actions, and it may enhance skills learning due to a partial overlap between brain structures and networks, the promotion of confidence towards a telemanipulator, and the feeling of congruence of the motor choice to the motor plan. We systematically reviewed studies aiming to verify the role of agency in improving learning. Fifteen studies were selected from MEDLINE and Scopus®. When a mismatch is introduced between observed and performed actions, the decrease in agency and learning is proportional to the intensity of the mismatch, which is due to greater interference with the motor programming. Thanks to multisensory integration, agency and learning benefit both from sensory and performance feedback and from the timing of feedback based on control at the goal level or the perceptual-motor level. This work constitutes a bedrock for professional teleoperation settings (e.g., robotic surgery), with particular reference to the role of agency in performing complex tasks with remote control.

On the course of goal pursuit: The influence of goal progress on explicit judgments of self-agency

The experience of causing our own actions and resulting outcomes (i.e., self-agency) is essential for the regulation of our actions during goal pursuit. In two experiments, participants indicated experienced self-agency over presented outcomes, which varied in distance to their goal in an agency-ambiguous task. In Study 1, progress was manipulated at trial level (i.e., stimuli moved randomly or sequentially towards the goal). In Study 2, progress was constant at trial level (sequential), but varied at task level (i.e., goal discrepancy of the outcomes was random or decreased over trials). Study 1 showed that self-agency gradually increased in the progress condition as unsuccessful outcomes were objectively closer to the goal, while self-agency increased exponentially upon full goal attainment in the absence of progress. The gradual pattern for the progress condition was replicated in Study 2. These studies indicate that explicit judgments of self-agency are more flexible when there is goal progress.

Time and time again: a multi-scale hierarchical framework for time-consciousness and timing of cognition

Temporality and the feeling of ‘now’ is a fundamental property of consciousness. Different conceptualizations of time-consciousness have argued that both the content of our experiences and the representations of those experiences evolve in time, or neither have temporal extension, or only content does. Accounting for these different positions, we propose a nested hierarchical model of multiple timescales that accounts for findings on timing of cognition and phenomenology of temporal experience. This framework hierarchically combines the three major philosophical positions on time-consciousness (i.e. cinematic, extensional and retentional) and presents a common basis for temporal experience. We detail the properties of these hierarchical levels and speculate how they could coexist mechanistically. We also place several findings on timing and temporal experience at different levels in this hierarchy and show how they can be brought together. Finally, the framework is used to derive novel predictions for both timing of our experiences and time perception. The theoretical framework offers a novel dynamic space that can bring together sub-fields of cognitive science like perception, attention, action and consciousness research in understanding and describing our experiences both in and of time.

An experimental paradigm for studying sense of agency in joint human-machine motor actions

In this paper, we propose an experimental technique for studying the sense of agency (SoA) in joint human-machine actions. This technique is based on the use of an electromechanical finger-lifting device that enables a joint motor action initiated by a participant and completed by the machine. The joint action, later referred to as an "active-passive" action, was implemented as a reaction time task and contrasted with other levels of participant's involvement, including active movement, passive movement, and observation of a dummy's movement. In each trial, a feedback sound signal informed the participant whether they had performed the task successfully, i.e. faster than a threshold, which was individually adjusted in the beginning of the experiment. In the active condition, the result depended on the participant, while in other conditions it was preprogrammed for the servo. In context of this task, we studied direct time estimates made by participants and auditory event-related potentials (ERP) in 20 healthy volunteers. The amplitude of the auditory N1 component in the responses to the feedback sound showed no significant effect of activity and success factors, while its latency was shorter in successful trials. Interaction of activity and success factors was significant for subjective time estimates. Surprisingly, the intentional binding effect (subjective compression of time intervals, which is known as a correlate of SoA) only emerged in trials of active condition with negative results. This observation was in contrast with the fact that the active and active-passive movements were both voluntarily initiated by the participant. We believe that studying SoA with the proposed technique may not only add to the understanding of agency but also provide practically relevant results for the development of human-machine systems such as exoskeletons.

The developmental profile of temporal binding: From childhood to adulthood

Temporal binding refers to a phenomenon whereby the time interval between a cause and its effect is perceived as shorter than the same interval separating two unrelated events. We examined the developmental profile of this phenomenon by comparing the performance of groups of children (aged 6–7, 7–8, and 9–10 years) and adults on a novel interval estimation task. In Experiment 1, participants made judgements about the time interval between (a) their button press and a rocket launch, and (b) a non-causal predictive signal and rocket launch. In Experiment 2, an additional causal condition was included in which participants made judgements about the interval between an experimenter’s button press and the launch of a rocket. Temporal binding was demonstrated consistently and did not change in magnitude with age: estimates of delay were shorter in causal contexts for both adults and children. In addition, the magnitude of the binding effect was greater when participants themselves were the cause of an outcome compared with when they were mere spectators. This suggests that although causality underlies the binding effect, intentional action may modulate its magnitude. Again, this was true of both adults and children. Taken together, these results are the first to suggest that the binding effect is present and developmentally constant from childhood into adulthood.

Changes in intentional binding effect during a novel perceptual-motor task

Perceptual-motor learning describes the process of improving the smoothness and accuracy of movements. Intentional binding (IB) is a phenomenon whereby the length of time between performing a voluntary action and the production of a sensory outcome during perceptual-motor control is perceived as being shorter than the reality. How IB may change over the course of perceptual-motor learning, however, has not been explicitly investigated. Here, we developed a set of IB tasks during perceptual-motor learning. Participants were instructed to stop a circular moving object by key press when it reached the center of a target circle on the display screen. The distance between the center of the target circle and the center of the moving object was measured, and the error was used to approximate the perceptual-motor performance index. This task also included an additional exercise that was unrelated to the perceptual-motor task: after pressing the key, a sound was presented after a randomly chosen delay of 200, 500, or 700 ms and the participant had to estimate the delay interval. The difference between the estimated and actual delay was used as the IB value. A cluster analysis was then performed using the error values from the first and last task to group the participants based on their perceptual-motor performance. Participants showing a very small change in error value, and thus demonstrating a small effect of perceptual-motor learning, were classified into cluster 1. Those who exhibited a large decrease in error value from the first to the last set, and thus demonstrated a strong improvement in perceptual-motor performance, were classified into cluster 2. Those who exhibited perceptual-motor learning also showed improvements in the IB value. Our data suggest that IB is elevated when perceptual-motor learning occurs.

Violation of expectations about movement and goal achievement leads to Sense of Agency reduction

The control of one's own movements and of their impact on the external world generates a feeling of control referred to as Sense of Agency (SoA). SoA is experienced when actions match predictions and is reduced by unpredicted events. The present study investigated the contribution of monitoring two fundamental components of action-movement execution and goal achievement-that have been most often explored separately in previous research. We have devised a new paradigm in which participants performed goal-directed actions while viewing an avatar's hand in a mixed-reality scenario. The hand performed either the same action or a different one, simultaneously or after various delays. Movement of the virtual finger and goal attainment were manipulated, so that they could match or conflict with the participants' expectations. We collected judgments of correspondence (an explicit index of SoA that overcomes the tendency to over-attribute actions to oneself) by asking participants if the observed action was synchronous or not with their action. In keeping with previous studies, we found that monitoring both movement execution and goal attainment is relevant for SoA. Moreover, we expanded previous findings by showing that movement information may be a more constant source of SoA modulation than goal information. Indeed, an incongruent movement impaired SoA irrespective of delay duration, while a missed goal did so only when delays were short. Our novel paradigm allowed us to simultaneously manipulate multiple action features, a characteristic that makes it suitable for investigating the contribution of different sub-components of action in modulating SoA in healthy and clinical populations.

Control Changes the Way We Look at the World

The feeling of control is a fundamental aspect of human experience and accompanies our voluntary actions all the time. However, how the sense of control interacts with wider perception, cognition, and behavior remains poorly understood. This study focused on how controlling an external object influences the allocation of attention. Experiment 1 examined attention to an object that is under a different level of control from the others. Participants searched for a target among multiple distractors on screen. All the distractors were partially under the participant's control (50% control level), and the search target was either under more or less control than the distractors. The results showed that, against this background of partial control, visual attention was attracted to an object only if it was more controlled than other available objects and not if it was less controlled. Experiment 2 examined attention allocation in contexts of either perfect control or no control over most of the objects. Specifically, the distractors were under either perfect (100%) control or no (0%) control, and the search target had one of six levels of control varying from 0% to 100%. When differences in control between the distractors and the target were small, visual attention was now more strongly drawn to search targets that were less controlled than distractors, rather than more controlled, suggesting attention to objects over which one might be losing control. Experiment 3 studied the events of losing or gaining control as opposed to the states of having or not having control. ERP measures showed that P300 amplitude proportionally encoded the magnitude of both increases and decreases in degree of control. However, losing control had more marked effects on P170 and P300 than gaining an equivalent degree of control, indicating high priority for efficiently detecting failures of control. Overall, our results suggest that controlled objects preferentially attract attention in uncontrolled environments. However, once control has been registered, the brain becomes highly sensitive to subsequent loss of control. Our findings point toward careful perceptual monitoring of degree of one's own agentic control over external objects. We suggest that control has intrinsic cognitive value because perceptual systems are organized to detect it and, once it has been acquired, to maintain it.

Measurement of the Perception of Control during Continuous Movement using Electroencephalography

“Sense of control” refers to the subjective feeling of control over external events. Numerous neuropsychological studies have investigated the neural basis of the sense of control during action performance; however, most previous studies have focused on responses to a single discrete action outcome rather than real-time processing of action-outcome sequences. In the present study, we aimed to identify whether certain patterns of brain activation are associated with the perceived control during continuous movement. We recorded electroencephalography (EEG) signals while participants continuously moved a right-handed mouse in an attempt to control multiple visual stimuli. When participants perceived a sense of control over the stimuli, we observed a positive potential approximately 550 ms after the onset of movement, while no similar potential was observed when participants reported a lack of control. The appearance of this potential was consistent with the time window of awareness of control in a behavioral test using the same task, and likely reflected the explicit allocation of attention to control. Moreover, we found that the alpha-mu rhythm, which is linked to sensorimotor processing, was significantly suppressed after participants came to a conclusion regarding the level of control, regardless of whether control or lack of control was perceived. In summary, our results suggest that the late positive potential after the onset of the movement and the suppression of alpha-mu rhythm can be used as markers of the perception of control during continuous action performance and feedback monitoring.

Intertemporal impulsivity can also arise from persistent failure of long-term plans

We suggest that steep intertemporal discounting in individuals of low socioeconomic status (SES) may arise as a rational metacognitive adaptation to experiencing planning and control failures in long-term plans. Low SES individuals' plans fail more frequently because they operate close to budgetary boundaries, in turn because they consistently operate with limited budgets of money, status, trust, or other forms of social utility.