Action Dynamics Reveal Parallel Competition in Decision Making

Attribute latencies causally shape intertemporal decisions

Intertemporal choices - decisions that play out over time - pervade our life. Thus, how people make intertemporal choices is a fundamental question. Here, we investigate the role of attribute latency (the time between when people start to process different attributes) in shaping intertemporal preferences using five experiments with choices between smaller-sooner and larger-later rewards. In the first experiment, we identify attribute latencies using mouse-trajectories and find that they predict individual differences in choices, response times, and changes across time constraints. In the other four experiments we test the causal link from attribute latencies to choice, staggering the display of the attributes. This changes attribute latencies and intertemporal preferences. Displaying the amount information first makes people more patient, while displaying time information first does the opposite. These findings highlight the importance of intra-choice dynamics in shaping intertemporal choices and suggest that manipulating attribute latency may be a useful technique for nudging.

Gender stereotypes and social perception of vocal confidence is mitigated by salience of socio-indexical cues to gender

Introduction

Socio-indexical cues to gender and vocal affect often interact and sometimes lead listeners to make differential judgements of affective intent based on the gender of the speaker. Previous research suggests that rising intonation is a common cue that both women and men produce to communicate lack of confidence, but listeners are more sensitive to this cue when it is produced by women. Some speech perception theories assume that listeners will track conditional statistics of speech and language cues (e.g., frequency of the socio-indexical cues to gender and affect) in their listening and communication environments during speech perception. It is currently less clear if these conditional statistics will impact listener ratings when context varies (e.g., number of talkers).

Methods

To test this, we presented listeners with vocal utterances from one female and one male-pitched voice (single talker condition) or many female/male-pitched voices (4 female voices; 4 female voices pitch-shifted to a male range) to examine how they impacted perceptions of talker confidence.

Results

Results indicated that when one voice was evaluated, listeners defaulted to the gender stereotype that the female voice using rising intonation (a cue to lack of confidence) was less confident than the male-pitched voice (using the same cue). However, in the multi-talker condition, this effect went away and listeners equally rated the confidence of the female and male-pitched voices.

Discussion

Findings support dual process theories of information processing, such that listeners may rely on heuristics when speech perception is devoid of context, but when there are no differentiating qualities across talkers (regardless of gender), listeners may be ideal adapters who focus on only the relevant cues.

Stereotypes shape response competition when forming impressions

Dynamic models of impression formation posit that bottom-up factors (e.g., a target's facial features) and top-down factors (e.g., perceiver knowledge of stereotypes) continuously interact over time until a stable categorization or impression emerges. Most previous work on the dynamic resolution of judgments over time has focused on either categorization (e.g., "is this person male/female?") or specific trait impressions (e.g., "is this person trustworthy?"). In two mousetracking studies-exploratory (N = 226) and confirmatory (N = 300)-we test a domain-general effect of cultural stereotypes shaping the process underlying impressions of targets. We find that the trajectories of participants' mouse movements gravitate toward impressions congruent with their stereotype knowledge. For example, to the extent that a participant reports knowledge of a "Black men are less [trait]" stereotype, their mouse trajectory initially gravitates toward categorizing individual Black male faces as "less [trait]," regardless of their final judgment of the target.

Cognitive Science Progresses Toward Interactive Frameworks

Despite its many twists and turns, the arc of cognitive science generally bends toward progress, thanks to its interdisciplinary nature. By glancing at the last few decades of experimental and computational advances, it can be argued that-far from failing to converge on a shared set of conceptual assumptions-the field is indeed making steady consensual progress toward what can broadly be referred to as interactive frameworks. This inclination is apparent in the subfields of psycholinguistics, visual perception, embodied cognition, extended cognition, neural networks, dynamical systems theory, and more. This pictorial essay briefly documents this steady progress both from a bird's eye view and from the trenches. The conclusion is one of optimism that cognitive science is getting there, albeit slowly and arduously, like any good science should.

Evidence for entropy maximisation in human free choice behaviour

The freedom to choose between options is strongly linked to notions of free will. Accordingly, several studies have shown that individuals demonstrate a preference for choice, or the availability of multiple options, over and above utilitarian value. Yet we lack a decision-making framework that integrates preference for choice with traditional utility maximisation in free choice behaviour. Here we test the predictions of an inference-based model of decision-making in which an agent actively seeks states yielding entropy (availability of options) in addition to utility (economic reward). We designed a study in which participants freely navigated a virtual environment consisting of two consecutive choices leading to reward locations in separate rooms. Critically, the choice of one room always led to two final doors while, in the second room, only one door was permissible to choose. This design allowed us to separately determine the influence of utility and entropy on participants' choice behaviour and their self-evaluation of free will. We found that choice behaviour was better predicted by an inference-based model than by expected utility alone, and that both the availability of options and the value of the context positively influenced participants' perceived freedom of choice. Moreover, this consideration of options was apparent in the ongoing motion dynamics as individuals navigated the environment. In a second study, in which participants selected between rooms that gave access to three or four doors, we observed a similar pattern of results, with participants preferring the room that gave access to more options and feeling freer in it. These results suggest that free choice behaviour is well explained by an inference-based framework in which both utility and entropy are optimised and supports the idea that the feeling of having free will is tightly related to options availability.

The action dynamics of approach-avoidance conflict during decision-making

Approach-avoidance conflict is observed in the competing motivations towards the benefits and away from the costs of a decision. The current study investigates the action dynamics of response motion during such conflicts in an attempt to characterise their dynamic resolution. An approach-avoidance conflict was generated by varying the appetitive consequences of a decision (i.e., point rewards and shorter participation time) in the presence of simultaneous aversive consequences (i.e., shock probability). Across two experiments, approach-avoidance conflict differentially affected response trajectories. Approach trajectories were less complex than avoidance trajectories and, as approach and avoidance motivations neared equipotentiality, response trajectories were more deflected from the shortest route to the eventual choice. Consistency in the location of approach and avoidance response options reduced variability in performance enabling more sensitive estimates of dynamic conflict. The time course of competing influences on response trajectories including trial-to-trial effects and conflict between approach and avoidance were estimated using regression analyses. We discuss these findings in terms of a dynamic theory of approach-avoidance that we hope will lead to insights of practical relevance in the field of maladaptive avoidance.

Taking the chance!-Interindividual differences in rule-breaking

While some individuals tend to follow norms, others, in the face of tempting but forbidden options, tend to commit rule-breaking when this action is beneficial for themselves. Previous studies have neglected such interindividual differences in rule-breaking. The present study fills this gap by investigating cognitive characteristics of individuals who commit spontaneous deliberative rule-breaking (rule-breakers) versus rule-followers. We developed a computerised task, in which 133 participants were incentivised to sometimes violate set rules which would-if followed-lead to a loss. While 52% of participants tended to break rules to obtain a benefit, 48% tended to follow rules even if this behaviour led to loss. Although rule-breakers experienced significantly more cognitive conflict (measured via response times and mouse movement trajectories) than rule-followers, they also obtained higher payoffs. In rule-breakers, cognitive conflict was more pronounced when violating the rules than when following them, and mainly during action planning. This conflict increased with frequent, recurrent, and early rule-breaking. Our results were in line with the Decision-Implementation-Mandatory switch-Inhibition model and thus extend the application of this model to the interindividual differences in rule-breaking. Furthermore, personality traits such as extroversion, disagreeableness, risk propensity, high impulsiveness seem to play a role in the appreciation of behaviours and cognitive characteristics of rule-followers and rule-breakers. This study opens the path towards the understanding of the cognitive characteristics of the interindividual differences in responses towards rules, and especially in spontaneous deliberative rule-breaking.

Ideomotor learning: Time to generalize a longstanding principle

The ideomotor principle holds that anticipating the sensory consequences of a movement triggers an associated motor response. Even though this framework dates back to the 19th century, it continues to lie at the heart of many contemporary approaches to human action control. Here we specifically focus on the ideomotor learning mechanism that has to precede action initiation via effect anticipation. Traditional approaches to this learning mechanism focused on establishing novel action-effect (or response-effect) associations. Here we apply the theoretical concept of common coding for action and perception to argue that the same learning principle should result in response-response and stimulus-stimulus associations just as well. Generalizing ideomotor learning in such a way results in a powerful and general framework of ideomotor action control, and it allows for integrating the two seemingly separate fields of ideomotor approaches and hierarchical learning.

Gender stereotypes drive perceptual differences of vocal confidence

One's ability to express confidence is critical to achieve one's goals in a social context-such as commanding respect from others, establishing higher social status, and persuading others. How individuals perceive confidence may be shaped by the socio-indexical cues produced by the speaker. In the current production/perception study, we asked four speakers (two cisgender women/men) to answer trivia questions under three speaking contexts: natural, overconfident, and underconfident (i.e., lack of confidence). An evaluation of the speakers' acoustics indicated that the speakers significantly varied their acoustic cues as a function of speaking context and that the women and men had significantly different acoustic cues. The speakers' answers to the trivia questions in the three contexts (natural, overconfident, underconfident) were then presented to listeners (N = 26) in a social judgment task using a computer mouse-tracking paradigm. Listeners were sensitive to the speakers' acoustic modulations of confidence and differentially interpreted these cues based on the perceived gender of the speaker, thereby impacting listeners' cognition and social decision making. We consider, then, how listeners' social judgments about confidence were impacted by gender stereotypes about women and men from social, heuristic-based processes.

The dynamics of decision-making and action during active sampling

Embodied Cognition Theories (ECTs) of decision-making propose that the decision process pervades the execution of choice actions and manifests itself in these actions. Decision-making scenarios where actions not only express the choice but also help sample information can provide a valuable, ecologically relevant model for this framework. We present a study to address this paradigmatic situation in humans. Subjects categorized (2AFC task) a central object image, blurred to different extents, by moving a cursor toward the left or right of the display. Upward cursor movements reduced the image blur and could be used to sample information. Thus, actions for decision and actions for sampling were orthogonal to each other. We analyzed response trajectories to test whether information-sampling movements co-occurred with the ongoing decision process. Trajectories were bimodally distributed, with one kind being direct towards one response option (non-sampling), and the other kind containing an initial upward component before veering off towards an option (sampling). This implies that there was an initial decision at the early stage of a trial, whether to sample information or not. Importantly, in sampling trials trajectories were not purely upward, but rather had a significant horizontal deviation early on. This result suggests that movements to sample information exhibit an online interaction with the decision process, therefore supporting the prediction of the ECTs under ecologically relevant constrains.

Neuro-Behavioral Dynamic Prediction of Interpersonal Cooperation and Aggression

How to quickly predict an individual's behavioral choices is an important issue in the field of human behavior research. Using noninvasive electroencephalography, we aimed to identify neural markers in the prior outcome-evaluation stage and the current option-assessment stage of the chicken game that predict an individual's behavioral choices in the subsequent decision-output stage. Hierarchical linear modeling-based brain-behavior association analyses revealed that midfrontal theta oscillation in the prior outcome-evaluation stage positively predicted subsequent aggressive choices; also, beta oscillation in the current option-assessment stage positively predicted subsequent cooperative choices. These findings provide electrophysiological evidence for the three-stage theory of decision-making and strengthen the feasibility of predicting an individual's behavioral choices using neural oscillations.

Expanding a Large Inclusive Study of Human Listening Rates

As conversational agents and digital assistants become increasingly pervasive, understanding their synthetic speech becomes increasingly important. Simultaneously, speech synthesis is becoming more sophisticated and manipulable, providing the opportunity to optimize speech rate to save users time. However, little is known about people’s abilities to understand fast speech. In this work, we provide an extension of the first large-scale study on human listening rates, enlarging the prior study run with 453 participants to 1,409 participants and adding new analyses on this larger group. Run on LabintheWild, it used volunteer participants, was screen reader accessible, and measured listening rate by accuracy at answering questions spoken by a screen reader at various rates. Our results show that people who are visually impaired, who often rely on audio cues and access text aurally, generally have higher listening rates than sighted people. The findings also suggest a need to expand the range of rates available on personal devices. These results demonstrate the potential for users to learn to listen to faster rates, expanding the possibilities for human-conversational agent interaction.

Contextualized Knowledge Reduces Misconceived COVID-19 Health Decisions

How do we resolve conflicting ideas about how to protect our health during a pandemic? Prior knowledge influences our decisions, potentially creating implicit cognitive conflict with new, correct information. COVID-19 provides a natural condition for investigating how an individual's health-specific knowledge (e.g., understanding mask efficacy) and their personal context (e.g., outbreak proximity) influence their protective health behavior endorsement, as information about the virus, its spread, and lethality has changed over time. Using a dual-process-model framework, we investigated the role cognitive conflict has on health decision-making. We used a computer mouse-tracking paradigm alongside geographical information systems (GIS) as a proxy for context. The results support a contextualized-deficit-model framework in which relevant knowledge and context-based factors help individuals override cognitive conflict to make more preventative health decisions. Findings from this study may provide evidence for a more effective way for experts to combat non-adherence due to conflicting health information.

Moving Beyond the Keypress: As Technology Advances, so Should Psychology Response Time Measurements

Decades of research in cognitive psychology have largely relied on simple key or button presses to quantify human behavior. While many valuable discoveries have been made, a richer response modality may reveal more information regarding the different processes that underlie complex human behavior. This study provides a proof of concept for using a touch-and-swipe response method to separate response time into two components to extract more meaningful behavioral insights. Across several analyses, the two components were consistently shown to be separable, independent measurements of behavior. Furthermore, evaluating these isolated response time components improved inferential power and clarity of behavioral patterns. The touch-and-swipe response method is simple and easy-to-use, and it shows promise for more accurately targeting mechanisms of interest.

Modulation of visually guided action by the image and familiar sizes of real-world objects

In daily life, two aspects of real-world object size perception—the image size of an object and its familiar size in the real world—are highly correlated. Thus, whether these two aspects of object size differently affect goal-directed action (e.g., manual pointing) and how have scarcely been examined. Here, participants reached to touch one of two simultaneously presented objects based on either their image or familiar size, which could be congruent or incongruent (e.g., a rubber duck presented as smaller and larger than a boat, respectively). We observed that when pointing to target objects in the incongruent conditions, participants’ movements were slower and were more curved toward the incorrect object compared with the movements in the congruent conditions. By comparing performance in the congruent and incongruent conditions, we concluded that both image size and familiar size influenced action even when task irrelevant, indicating that both are processed automatically (Konkle & Oliva, 2012a). Image size, however, showed influence earlier in the course of movements and more robustly overall than familiar size. We additionally found that greater relative familiar size differences mitigated the impact of image size processing and increased the impact of familiar size processing on pointing movements. Overall, our data suggest that image size and familiar size perception interact both with each other and with visually guided action, but that the relative contributions of each are unequal and vary based on task demands.

Reducing variance or helping the poorest? A mouse tracking approach to investigate cognitive bases of inequality aversion in resource allocation

Humans dislike unequal allocations. Although often conflated, such 'inequality-averse' preferences are separable into two elements: egalitarian concern about the variance and maximin concern about the poorest (maximizing the minimum). Recent research has shown that the maximin concern operates more robustly in allocation decisions than the egalitarian concern. However, the real-time cognitive dynamics of allocation decisions are still unknown. Here, we examined participants' choice behaviour with high temporal resolution using a mouse-tracking technique. Participants made a series of allocation choices for others between two options: a 'non-Utilitarian option' with both smaller variance and higher minimum pay-off (but a smaller total) compared with the other 'Utilitarian option'. Choice data confirmed that participants had strong inequality-averse preferences, and when choosing non-utilitarian allocations, participants' mouse movements prior to choices were more strongly determined by the minimum elements of the non-Utilitarian options than the variance elements. Furthermore, a time-series analysis revealed that this dominance emerged at a very early stage of decision making (around 500 ms after the stimulus onset), suggesting that the maximin concern operated as a strong cognitive anchor almost instantaneously. Our results provide the first temporally fine-scale evidence that people weigh the maximin concern over the egalitarian concern in distributive judgements.

Science with Duplo: Multilevel goal management in preschoolers' toy house constructions

Executing goal-directed action sequences is fundamental to our behavior. Planning and controlling these action sequences improves greatly over the preschool years. In this study, we examined preschoolers' ability to plan action sequences. A total of 69 3- to 5-year-olds were assessed on an action sequence planning task with a hierarchical goal structure and on several executive function tasks. Planning abilities improved with age. Improvements in inhibition were related to avoidance of actions irrelevant to the goal hierarchy. Updating skill appears to be associated with executing actions relevant to different subgoals. Using optical motion capture, we showed that children who followed the subgoals displayed less movement with their nonreaching hand within a subgoal. This effect was enhanced in children with better inhibitory skills, suggesting that such skills allow greater focus on executing the current subgoal. Thus, we provide evidence that structuring of subgoals in action sequence planning emerges during the preschool years and that improvements in performance in action sequence planning are related to executive functions.

Predictions of Miscommunication in Verbal Communication During Collaborative Joint Action

Purpose The purpose of the current study was to examine the lexical and pragmatic factors that may contribute to turn-by-turn failures in communication (i.e., miscommunication) that arise regularly in interactive communication. Method Using a corpus from a collaborative dyadic building task, we investigated what differentiated successful from unsuccessful communication and potential factors associated with the choice to provide greater lexical information to a conversation partner. Results We found that more successful dyads' language tended to be associated with greater lexical density, lower ambiguity, and fewer questions. We also found participants were more lexically dense when accepting and integrating a partner's information (i.e., grounding) but were less lexically dense when responding to a question. Finally, an exploratory analysis suggested that dyads tended to spend more lexical effort when responding to an inquiry and used assent language accurately-that is, only when communication was successful. Conclusion Together, the results suggest that miscommunication both emerges and benefits from ambiguous and lexically dense utterances.

Detecting faking-good response style in personality questionnaires with four choice alternatives

Deliberate attempts to portray oneself in an unrealistic manner are commonly encountered in the administration of personality questionnaires. The main aim of the present study was to explore whether mouse tracking temporal indicators and machine learning models could improve the detection of subjects implementing a faking-good response style when answering personality inventories with four choice alternatives, with and without time pressure. A total of 120 volunteers were randomly assigned to one of four experimental groups and asked to respond to the Virtuous Responding (VR) validity scale of the PPI-R and the Positive Impression Management (PIM) validity scale of the PAI via a computer mouse. A mixed design was implemented, and predictive models were calculated. The results showed that, on the PIM scale, faking-good participants were significantly slower in responding than honest respondents. Relative to VR items, PIM items are shorter in length and feature no negations. Accordingly, the PIM scale was found to be more sensitive in distinguishing between honest and faking-good respondents, demonstrating high classification accuracy (80–83%).

Cognitive Processing of Miscommunication in Interactive Listening: An Evaluation of Listener Indecision and Cognitive Effort

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse-tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

Design choices: Empirical recommendations for designing two-dimensional finger-tracking experiments

The continuous tracking of mouse or finger movements has become an increasingly popular research method for investigating cognitive and motivational processes such as decision-making, action-planning, and executive functions. In the present paper, we evaluate and discuss how apparently trivial design choices of researchers may impact participants' behavior and, consequently, a study's results. We first provide a thorough comparison of mouse- and finger-tracking setups on the basis of a Simon task. We then vary a comprehensive set of design factors, including spatial layout, movement extent, time of stimulus onset, size of the target areas, and hit detection in a finger-tracking variant of this task. We explore the impact of these variations on a broad spectrum of movement parameters that are typically used to describe movement trajectories. Based on our findings, we suggest several recommendations for best practice that avoid some of the pitfalls of the methodology. Keeping these recommendations in mind will allow for informed decisions when planning and conducting future tracking experiments.

Social Judgments of Digitally Manipulated Stuttered Speech: Cognitive Heuristics Drive Implicit and Explicit Bias

Purpose People who stutter are susceptible to discrimination, stemming from negative stereotypes and social misattributions. There has been a recent push to evaluate the underlying explicit and implicit cognitive mechanisms associated with social judgments, moving away from only evaluating explicit social bias about people who stutter. The purpose of the current study was to evaluate how listeners change their implicit and explicit social (mis)attributions after hearing a people who stutter produce disfluent speech. Method The current project was an adaptation of the Byrd et al. (2017) study to evaluate listener implicit/explicit social judgments of stuttered speech across five categories (i.e., confidence, friendliness, intelligence, distractibility, and extroversion) before and after a stuttering self-disclosure. This was done by implementing a modified version of the Ferguson et al. (2019) computer mouse-tracking paradigm. Results Consistent with previous findings, participants made more explicit positive social judgments of confidence, friendliness, extroversion, and intelligence after a stuttering self-disclosure, but the distractedness category was resistant to change. Also consistent with previous findings, participants experienced a higher degree of cognitive competition (i.e., higher area under the curve) shortly after self-disclosure, which lessened over time. Conclusions Explicit and implicit biases exist, but self-disclosure significantly impacts the cognitive system of listeners. Specifically, self-disclosure may reduce explicit bias through experience and explicit belief updating, but when cognitive heuristics are strong, implicit bias may be slower to change.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

A response-locking protocol to boost sensitivity for fMRI-based neurochronometry

The timeline of brain‐wide neural activity relative to a behavioral event is crucial when decoding the neural implementation of a cognitive process. Yet, fMRI assesses neural processes indirectly via delayed and regionally variable hemodynamics. This method‐inherent temporal distortion impacts the interpretation of behavior‐linked neural timing. Here we describe a novel behavioral protocol that aims at disentangling the BOLD dynamics of the pre‐ and post‐response periods in response time tasks. We tested this response‐locking protocol in a perceptual decision‐making (random dot) task. Increasing perceptual difficulty produced expected activity increases over a broad network involving the lateral/medial prefrontal cortex and the anterior insula. However, response‐locking revealed a previously unreported functional dissociation within this network. preSMA and anterior premotor cortex (prePMV) showed post‐response activity modulations while anterior insula and anterior cingulate cortex did not. Furthermore, post‐response BOLD activity at preSMA showed a modulation in timing but not amplitude while this pattern was reversed at prePMV. These timeline dissociations with response‐locking thus revealed three functionally distinct sub‐networks in what was seemingly one shared distributed network modulated by perceptual difficulty. These findings suggest that our novel response‐locked protocol could boost the timing‐related sensitivity of fMRI.

Use of mouse-tracking software to detect faking-good behavior on personality questionnaires: an explorative study

The aim of the present study was to explore whether kinematic indicators could improve the detection of subjects demonstrating faking-good behaviour when responding to personality questionnaires. One hundred and twenty volunteers were randomly assigned to one of four experimental groups (honest unspeeded, faking-good unspeeded, honest speeded, and faking-good speeded). Participants were asked to respond to the MMPI-2 underreporting scales (L, K, S) and the PPI-R Virtuous Responding (VR) scale using a computer mouse. The collected data included T-point scores on the L, K, S, and VR scales; response times on these scales; and several temporal and spatial mouse parameters. These data were used to investigate the presence of significant differences between the two manipulated variables (honest vs. faking-good; speeded vs. unspeeded). The results demonstrated that T-scores were significantly higher in the faking-good condition relative to the honest condition; however, faking-good and honest respondents showed no statistically significant differences between the speeded and unspeeded conditions. Concerning temporal and spatial kinematic parameters, we observed mixed results for different scales and further investigations are required. The most consistent finding, albeit with small observed effects, regards the L scale, in which faking-good respondents took longer to respond to stimuli and outlined wider mouse trajectories to arrive at the given response.

Reaching decisions during ongoing movements

Neurophysiological studies suggest that when decisions are made between concrete actions, the selection process involves a competition between potential action representations in the same sensorimotor structures involved in executing those actions. However, it is unclear how such models can explain situations, often encountered during natural behavior, in which we make decisions while were are already engaged in performing an action. Does the process of deliberation characterized in classical studies of decision-making proceed the same way when subjects are deciding while already acting? In the present study, human subjects continuously tracked a target moving in the horizontal plane and were occasionally presented with a new target to which they could freely choose to switch at any time, whereupon it became the new tracked target. We found that the probability of choosing to switch increased with decreasing distance to the new target and increasing size of the new target relative to the tracked target, as well as when the direction to the new target was aligned (either toward or opposite) to the current tracking direction. However, contrary to our expectations, subjects did not choose targets that minimized the energetic costs of execution, as calculated by a biomechanical model of the arm. When the constraints of continuous tracking were removed in variants of the task involving point-to-point movements, the expected preference for lower cost choices was seen. These results are discussed in the context of current theories of nested feedback control, internal models of forward dynamics, and high-dimensional neural spaces.NEW & NOTEWORTHY Current theories of decision-making primarily address how subjects make decisions before executing selected actions. However, in our daily lives we often make decisions while already performing some action (e.g., while playing a sport or navigating through a crowd). To gain insight into how current theories can be extended to such "decide-while-acting" scenarios, we examined human decisions during continuous manual tracking and found some intriguing departures from how decisions are made in classical "decide-then-act" paradigms.

Social Judgments of Digitally Manipulated Stuttered Speech: An Evaluation of Self-Disclosure on Cognition

Purpose Persons who stutter (PWS) may be susceptible to discrimination because of negative judgments made by listeners. The current study sought to determine how the cognitive system's explicit (i.e., conscious) and implicit (i.e., nonconscious) biases about PWS are impacted by self-disclosure. Method A computer mouse-tracking paradigm was used to evaluate categorical social judgments about PWS. Computer mouse trajectories, which have been shown to reveal underlying cognitive pull or competition between opposing concepts, were used to measure implicit bias (i.e., nonconscious stereotypes). Participants were asked to explicitly categorize the speaker as either intelligent or unintelligent before and after listening to a speaker self-disclose. Mouse cursor trajectories during the explicit response categorization were used to evaluate implicit bias associated with the decision-making process. Results Results indicated that participants chose "intelligent" for a higher proportion of the trials in the disclosure condition compared to baseline, showing that listeners' explicit biases changed after listening to a self-disclosure that the speaker stutters. Results also indicated listeners exhibited a more negative implicit bias, based on computer mouse trajectories, when rating the PWS relative to the "persons who do not stutter" talker, but this negative implicit bias did seem to reduce over time after the disclosure was made. Conclusions These findings indicate that, even though explicit and implicit biases were evident when listeners heard stuttering, both explicit and implicit biases seemed to extinguish over time after a self-disclosure. Although the bias was not completely extinguished, these results provide promising evidence toward developing methods to reduce negative beliefs and reactions toward PWS. Supplemental Material http://osf.io/mwrp7/.

Psychometrics of the continuous mind: Measuring cognitive sub-processes via mouse tracking

The measurement of psychological properties often relies on discrete measures, for example, answers in questionnaires or responses in tasks. This focus on discrete measures neglects information that is present in the process leading to an answer or a response. A method to trace such processes is mouse tracking. Mouse tracking promises to open a continuous window onto the processes leading from a stimulus to a response. However, most mouse-tracking studies fall short of the promise to extract dynamic psychometrically valid markers for the different sub-processes, which are intertwined on the way to the final response. Here we used time-continuous multiple regression (TCMR) to extract dynamic markers for the different sub-processes leading to a response. From these markers, we extracted information about the timing, the duration, and the strength of the influence of the different sub-processes. We evaluated these dynamic measures of sub-processes for their psychometric properties, i.e. reliability, which is a basis for their use in the study of individual differences. Furthermore, we applied these dynamic measures in a group-level study to identify differences in the sub-processes of resolving response conflict between groups performing either a Simon or a flanker task. We found specific temporal patterns that match predictions from a conceptual model of these tasks. We concluded that the extracted information from mouse movements could be used as psychometrically valid dynamic measures of psychological properties and their differences across individuals and situations.A software toolbox to perform the described analyses in Matlab is provided (osf.io/5e3vn).

Reduced competition between tool action neighbors in left hemisphere stroke

When pantomiming the use of tools, patients with limb apraxia after left hemisphere stroke (LCVA) produce more spatiotemporal hand action errors with tools associated with conflicting actions for use versus grasp-to-pick-up (e.g., corkscrew) than tools having a single action for both use and grasp (e.g., hammer). There are two possible accounts for this pattern of results. Reduced performance with 'conflict' tools may simply reflect weakened automaticity of use action activation, which is evident only when the use and grasp actions are not redundant. Alternatively, poor use performance may reflect a reduced ability of appropriate tool use actions to compete with task-inappropriate action representations. To address this issue, we developed a Stroop-like experiment in which 21 LCVA and 8 neurotypical participants performed pantomime actions in blocks containing two tools that were similar ("neighbors") in terms of hand action or function, or were unrelated on either dimension. In a congruent condition, they pantomimed the use action associated with the visually presented tool, whereas in an incongruent condition, they pantomimed the use action for the other tool in the block. Relative to controls and other task conditions, LCVA participants showed reductions in hand action errors in incongruent relative to congruent action trials; furthermore, the degree of reduction in this incongruence effect was related to the participants' susceptibility to grasp-on-use conflict in a separate test of pantomime to the sight of tools. Support vector regression lesion-symptom mapping analyses identified the left inferior frontal gyrus, supramarginal gyrus, and superior longitudinal fasciculus as core neuroanatomical sites associated with abnormal performance. Collectively, the results indicate that weakened activation of tool use actions in limb apraxia gives rise to reduced ability of these actions to compete for task-appropriate selection when competition arises within single tools (grasp-on-use conflict) as well as between two tools (reduced neighborhood effects).

Gaze and Motor Traces of Language Processing: Evidence from Autism Spectrum Disorders in Comparison to Typical Controls

We investigated what strategies underlie figurative language processing in two groups of participants distinguished by the presence of a developmental deficit, highly-verbal participants with autism, and control participants without autism in two age ranges each. Individuals with autism spectrum disorder are characterised by impaired social interaction and communication. Even at the high end of the spectrum, where structural language is adequate, difficulties in comprehending non-literal aspects of language are widely attested. The exact causes of these problems are, however, still open to debate. In an interactive sentence-picture matching task participants selected the most suitable image representation of a non-literal figurative expression that matched the target meaning, while their eye-movements and hand movements were being tracked. Our results suggest that individuals with ASD have different processing patterns than typically developing peers when interpreting figurative language, even when they provide the correct answers. Both children with and without autism, and participants with autism display greater uncertainty and competition between alternatives when providing the answer, often reflected in also considering the literal interpretation of the expression against its target figurative meaning. We provide evidence that expression transparency and decomposability play a central role in figurative language processing across all groups.

Tracking Mouse Trajectories Related to Decisions About Sexual Interest

The current research explored continuous behavioral processes by recording participants' hand movements toward a response option using Mousetracker software. Across three studies, we tested the idea that sexual interest-related decisions can be indexed using automatic movements. Using a UK sample of self-identified same- and opposite-gender attracted men (N = 43), Study 1 showed that the process of approaching the response button was faster, more direct, and less curved when participants responded from their own (vs. a non-preferred) perspective. Study 2 supported these findings using a German sample of self-identified same- and opposite-gender attracted men (N = 66). Using a teleiophilic sample of 100 self-identified opposite-gender attracted men (n = 51) and women (n = 49), Study 3 examined age-specific sexual interests (i.e., responding to stimuli from a pedophilic and a teleiophilic perspective). As expected, in the teleiophilic block, participants' responses were faster, more direct, and less curved than in the pedophilic block. Collectively, the results suggest that mousetracking shows promise as a measure of sexual interest (across the dimension of both gender and age), providing grounds for future research.

Beyond reach: Do symmetric changes in motor costs affect decision making? A registered report

Executing an important decision can be as easy as moving a mouse cursor or reaching towards the preferred option with a hand. But would we decide differently if choosing required walking a few steps towards an option? More generally, is our preference invariant to the means and motor costs of reporting it? Previous research demonstrated that asymmetric motor costs can nudge the decision-maker towards a less costly option. However, virtually all traditional decision-making theories predict that increasing motor costs symmetrically for all options should not affect choice in any way. This prediction is disputed by the theory of embodied cognition, which suggests that motor behavior is an integral part of cognitive processes, and that motor costs can affect our choices. In this registered report, we investigated whether varying motor costs can affect response dynamics and the final choices in an intertemporal choice task: choosing between a readily available small reward and a larger but delayed reward. Our study compared choices reported by moving a computer mouse cursor towards the preferred option with the choices executed via a more motor costly walking procedure. First, we investigated whether relative values of the intertemporal choice options affect walking trajectories in the same way as they affect mouse cursor dynamics. Second, we tested a hypothesis that, in the walking condition, increased motor costs of a preference reversal would decrease the number of changes-of-mind and therefore increase the proportion of impulsive, smaller-but-sooner choices. We confirmed the hypothesis that walking trajectories reflect covert dynamics of decision making, and rejected the hypothesis that increased motor costs of responding affect decisions in an intertemporal choice task. Overall, this study contributes to the empirical basis enabling the decision-making theories to address the complex interplay between cognitive and motor processes.

Collective benefit in joint perceptual judgments: Partial roles of shared environments, meta-cognition, and feedback

Recent research has demonstrated that two persons can optimally combine their observations to make better decisions when they can verbally communicate their confidence to each other. The present study investigated whether non-verbal interaction in a shared environment can be sufficient to achieve similar collective benefit. Pairs of individuals performed a localization task in a shared virtual 3D environment. In Experiments 1 and 2, partners had access to orthogonal viewpoints providing complementary information. The results showed robust collective benefit compared to individual performance from a single viewpoint, which could be obtained without any opportunity for verbal communication and even when no feedback about joint accuracy was provided (Experiment 2). When partners shared the same viewpoint (Experiment 3), collective benefit was achieved only when feedback on accuracy was provided (Experiment 3a). The findings indicate that sharing an environment can be sufficient for achieving integration of complementary perceptual information. Communicating confidence might not be necessary when an environment is shared. Another possibility is that processes for integrating interpersonally continuous information generally differ from the processes invoked when making a joint dichotomous choice.

Examining reproducibility in psychology: A hybrid method for combining a statistically significant original study and a replication

The unrealistically high rate of positive results within psychology has increased the attention to replication research. However, researchers who conduct a replication and want to statistically combine the results of their replication with a statistically significant original study encounter problems when using traditional meta-analysis techniques. The original study's effect size is most probably overestimated because it is statistically significant, and this bias is not taken into consideration in traditional meta-analysis. We have developed a hybrid method that does take the statistical significance of an original study into account and enables (a) accurate effect size estimation, (b) estimation of a confidence interval, and (c) testing of the null hypothesis of no effect. We analytically approximate the performance of the hybrid method and describe its statistical properties. By applying the hybrid method to data from the Reproducibility Project: Psychology (Open Science Collaboration, 2015), we demonstrate that the conclusions based on the hybrid method are often in line with those of the replication, suggesting that many published psychological studies have smaller effect sizes than those reported in the original study, and that some effects may even be absent. We offer hands-on guidelines for how to statistically combine an original study and replication, and have developed a Web-based application ( https://rvanaert.shinyapps.io/hybrid ) for applying the hybrid method.

Retrieval dynamics of recognition and rejection

Recognition memory is often viewed as the end-product of discrete cognitive events, involving the combination of latent operations such as the assessment of memory strength, the decision time, and the memory judgement. Recently, researchers have begun using the physical dynamics of memory retrieval to provide insight into the dynamic, possibly non-discrete, processes that underlie memory decisions. In this study, the underlying distributional properties of targets and lures were manipulated by populating lists with items drawn from either homogeneous or heterogeneous word frequency and context variability ranges. In all conditions, participants' x-, y-mouse coordinates were recorded as they processed test items, allowing estimates of response dynamics (e.g., initial deviation and area under the curve [AUC]), and eventual old/new responses. The stimulus manipulations affected the distribution shapes and, to a greater degree, the placements of subjective confidence thresholds. We observed tight correspondences between confidence and AUC for both hits and correct rejections. We interpret these results within dynamic models of recognition memory.

Deficits in the Use of Verb Bias Information in Real-Time Processing by College Students With Developmental Language Disorder

Purpose This study examined whether college students with developmental language disorder (DLD) showed similar sensitivity to verb bias information during real-time sentence processing as typically developing (TD) peers. Method Seventeen college students with DLD and 16 TD college students participated in a mouse-tracking experiment that utilized the visual world paradigm to examine real-time sentence processing. In experimental trials, participants chose 1 of 2 pictured interpretations of a sentence. Measures of interest were the choice of interpretation and the amount of competition from the unchosen picture as measured by mouse curvature. Results Choice of interpretation and mouse movements by college students with DLD suggested less sensitivity to verb bias information than their TD peers. Conclusion College students with DLD showed less evidence of sensitivity to verb bias information than their TD peers in this task. Their performance may reflect the use of compensatory processing strategies and may be related to poor comprehension abilities often observed in this population.

Mouse tracking as a window into decision making

Mouse tracking promises to be an efficient method to investigate the dynamics of cognitive processes: It is easier to deploy than eyetracking, yet in principle it is much more fine-grained than looking at response times. We investigated these claimed benefits directly, asking how the features of decision processes-notably, decision changes-might be captured in mouse movements. We ran two experiments, one in which we explicitly manipulated whether our stimuli triggered a flip in decision, and one in which we replicated more ecological, classical mouse-tracking results on linguistic negation (Dale & Duran, Cognitive Science, 35, 983-996, 2011). We concluded, first, that spatial information (mouse path) is more important than temporal information (speed and acceleration) for detecting decision changes, and we offer a comparison of the sensitivities of various typical measures used in analyses of mouse tracking (area under the trajectory curve, direction flips, etc.). We do so using an "optimal" analysis of our data (a linear discriminant analysis explicitly trained to classify trajectories) and see what type of data (position, speed, or acceleration) it capitalizes on. We also quantify how its results compare with those based on more standard measures.

Unpacking decision difficulty: Testing action dynamics in Intertemporal, gamble, and consumer choices

The study examined the two-factor structure of decision difficulty proposed by Cheng and González-Vallejo (2017) in new domains, and the role of numeracy in relation to these factors. Using the measurement methodology of 'mouse' (cursor) movements, participants' temporal and spatial measures were recorded when making decisions in the domains of intertemporal, gamble, and consumer choices. Task manipulations designed to affect difficulty included the sign of the payoffs (gains vs. losses), the similarity of the attribute values being compared, and attribute importance. A psychometric analysis of the measures revealed three orthogonal components, two of which, conflict and wavering, described decision difficulty. The conflict component was most affected by changes in the sign of the payoffs of intertemporal and gamble choices, with greater means observed in the loss than in the gain context. By contrast, the wavering component was most affected by changes of the similarity between the options' attributes, with greater means when the options were more similar. The study also found that choosing the long-term advantageous options in an intertemporal choice task; choosing the riskier gain and safer loss in a gamble choice task; and choosing the more expensive/better-quality hotel in a consumer choice task demonstrated greater conflict and/or wavering. The study further found that numeracy, or the degree to which individuals are able to use and interpret numbers, was negatively related to the conflict component. Taken together, the study demonstrated that decision difficulty varied with contextual changes, and action-dynamic measures reflected different facets of decision difficulty.

Single reach plans in dorsal premotor cortex during a two-target task

In many situations, we are faced with multiple potential actions, but must wait for more information before knowing which to perform. Movement scientists have long asked whether in these delayed-response situations the brain plans both potential movements simultaneously, or if it simply chooses one and then switches later if necessary. To answer this question, we used simultaneously recorded activity from populations of neurons in macaque dorsal premotor cortex to track moment-by-moment deliberation between two potential reach targets. We found that the neural activity only ever indicated a single-reach plan (with some targets favored more than others), and that initial plans often predicted the monkeys’ behavior on both Free-Choice trials and incorrect Cued trials. Our results suggest that premotor cortex plans only one option at a time, and that decisions are strongly influenced by the initial response to the available set of movement options.

It is debated whether motor cortical activity reflects plans for multiple potential actions. Here, the authors report that in a delayed response task with two potential reach targets, population activity in the dorsal premotor cortex at any moment in time represents only one of the targets.

Doing psychological science by hand

Over the past decade, mouse-tracking in choice tasks has become a popular method across psychological science. This method exploits hand movements as a measure of multiple response activations that can be tracked continuously over hundreds of milliseconds. Whereas early mouse-tracking research focused on specific debates, researchers have realized the methodology has far broader theoretical value. This more recent work demonstrates that mouse-tracking is a widely applicable measure across the field, capable of exposing the micro-structure of real-time decisions including their component processes and millisecond-resolution time-course in ways that inform theory. In the article, recent advances in the mouse-tracking approach are described, and comparisons with the gold standard measure of reaction time and other temporally-sensitive methodologies are provided. Future directions, including mapping to neural representations with brain-imaging and ways to improve our theoretical understanding of mouse-tracking methodology, are discussed.

Statistical Models for Predicting Threat Detection From Human Behavior

Users must regularly distinguish between secure and insecure cyber platforms in order to preserve their privacy and safety. Mouse tracking is an accessible, high-resolution measure that can be leveraged to understand the dynamics of perception, categorization, and decision-making in threat detection. Researchers have begun to utilize measures like mouse tracking in cyber security research, including in the study of risky online behavior. However, it remains an empirical question to what extent real-time information about user behavior is predictive of user outcomes and demonstrates added value compared to traditional self-report questionnaires. Participants navigated through six simulated websites, which resembled either secure “non-spoof” or insecure “spoof” versions of popular websites. Websites also varied in terms of authentication level (i.e., extended validation, standard validation, or partial encryption). Spoof websites had modified Uniform Resource Locator (URL) and authentication level. Participants chose to “login” to or “back” out of each website based on perceived website security. Mouse tracking information was recorded throughout the task, along with task performance. After completing the website identification task, participants completed a questionnaire assessing their security knowledge and degree of familiarity with the websites simulated during the experiment. Despite being primed to the possibility of website phishing attacks, participants generally showed a bias for logging in to websites versus backing out of potentially dangerous sites. Along these lines, participant ability to identify spoof websites was around the level of chance. Hierarchical Bayesian logistic models were used to compare the accuracy of two-factor (i.e., website security and encryption level), survey-based (i.e., security knowledge and website familiarity), and real-time measures (i.e., mouse tracking) in predicting risky online behavior during phishing attacks. Participant accuracy in identifying spoof and non-spoof websites was best captured using a model that included real-time indicators of decision-making behavior, as compared to two-factor and survey-based models. Findings validate three widely applicable measures of user behavior derived from mouse tracking recordings, which can be utilized in cyber security and user intervention research. Survey data alone are not as strong at predicting risky Internet behavior as models that incorporate real-time measures of user behavior, such as mouse tracking.