EZ-CDM: Fast, simple, robust, and accurate estimation of circular diffusion model parameters

The investigation of cognitive processes that form the basis of decision-making in paradigms involving continuous outcomes has gained the interest of modeling researchers who aim to develop a dynamic decision theory that accounts for both speed and accuracy. One of the most important of these continuous models is the circular diffusion model (CDM, Smith. Psychological Review, 123(4), 425. 2016), which posits a noisy accumulation process mathematically described as a stochastic two-dimensional Wiener process inside a disk. Despite the considerable benefits of this model, its mathematical intricacy has limited its utilization among scholars. Here, we propose a straightforward and user-friendly method for estimating the CDM parameters and fitting the model to continuous-scale data using simple formulas that can be readily computed and do not require theoretical knowledge of model fitting or extensive programming. Notwithstanding its simplicity, we demonstrate that the aforementioned method performs with a level of accuracy that is comparable to that of the maximum likelihood estimation method. Furthermore, a robust version of the method is presented, which maintains its simplicity while exhibiting a high degree of resistance to contaminant responses. Additionally, we show that the approach is capable of reliably measuring the key parameters of the CDM, even when these values are subject to across-trial variability. Finally, we demonstrate the practical application of the method on experimental data. Specifically, an illustrative example is presented wherein the method is employed along with estimating the probability of guessing. It is hoped that the straightforward methodology presented here will, on the one hand, help narrow the divide between theoretical constructs and empirical observations on continuous response tasks and, on the other hand, inspire cognitive psychology researchers to shift their laboratory investigations towards continuous response paradigms.

A tutorial on fitting joint models of M/EEG and behavior to understand cognition

We present motivation and practical steps necessary to find parameter estimates of joint models of behavior and neural electrophysiological data. This tutorial is written for researchers wishing to build joint models of human behavior and scalp and intracranial electroencephalographic (EEG) or magnetoencephalographic (MEG) data, and more specifically those researchers who seek to understand human cognition. Although these techniques could easily be applied to animal models, the focus of this tutorial is on human participants. Joint modeling of M/EEG and behavior requires some knowledge of existing computational and cognitive theories, M/EEG artifact correction, M/EEG analysis techniques, cognitive modeling, and programming for statistical modeling implementation. This paper seeks to give an introduction to these techniques as they apply to estimating parameters from neurocognitive models of M/EEG and human behavior, and to evaluate model results and compare models. Due to our research and knowledge on the subject matter, our examples in this paper will focus on testing specific hypotheses in human decision-making theory. However, most of the motivation and discussion of this paper applies across many modeling procedures and applications. We provide Python (and linked R) code examples in the tutorial and appendix. Readers are encouraged to try the exercises at the end of the document.

Determining the Relativity of Word Meanings Through the Construction of Individualized Models of Semantic Memory

Distributional models of lexical semantics are capable of acquiring sophisticated representations of word meanings. The main theoretical insight provided by these models is that they demonstrate the systematic connection between the knowledge that people acquire and the experience that they have with the natural language environment. However, linguistic experience is inherently variable and differs radically across people due to demographic and cultural variables. Recently, distributional models have been used to examine how word meanings vary across languages and it was found that there is considerable variability in the meanings of words across languages for most semantic categories. The goal of this article is to examine how variable word meanings are across individual language users within a single language. This was accomplished by assembling 500 individual user corpora attained from the online forum Reddit. Each user corpus ranged between 3.8 and 32.3 million words each, and a count-based distributional framework was used to extract word meanings for each user. These representations were then used to estimate the semantic alignment of word meanings across individual language users. It was found that there are significant levels of relativity in word meanings across individuals, and these differences are partially explained by other psycholinguistic factors, such as concreteness, semantic diversity, and social aspects of language usage. These results point to word meanings being fundamentally relative and contextually fluid, with this relativeness being related to the individualized nature of linguistic experience.

Editor's Introduction: Best Papers from the 20th International Conference on Cognitive Modeling

The International Conference on Cognitive Modelling is dedicated to understanding how the complex processes of the mind can be explained in terms of detailed inner processing. In this issue, we present four representative papers of this field of research from our 20th meeting, ICCM 2022. This meeting was our first hybrid meeting, with a virtual version happening July 11-15, 2022, and an in-person event from July 23-27, 2022, held in Toronto, Canada. The four papers presented here were the top-ranked papers across both the virtual and in-person events. Three of the papers develop novel computational theories about low-level components within the mind and how those components result in high-level phenomena such as motivation, anhedonia, and attention. The final paper demonstrates the use of cognitive modeling to develop novel explanations of a paired associate learning task, and uses those insights to develop and explain human performance in a more complex version of that task.

Peer-Assisted Learning Is More Effective at Higher Task Complexity and Difficulty

This paper presents two studies in which a peer-assisted learning condition was compared to an individual learning condition. The first study used the paired-associates learning task and the second study used an incrementally more complex task-the remote associate test. Participants in the peer-assisted learning condition worked in groups of four. They had to solve a given problem individually and give a first answer before being able to request to see their peers' solutions; then, a second answer was issued. After six sessions of peer-assisted practice, a final individual test was administered. Peer interaction was found to benefit learning in both studies but the benefit transferred to the final test only in the second study. Fine-grained behavioral analyses and computational modeling suggested that the benefits of peer interaction were (partially) offset by its costs, particularly increased cognitive load and error exposure. Overall, the superiority of peer-assisted learning over individual learning was more pronounced in the more complex task and for the more difficult problems in that task.

Modeling novice law enforcement officers' interaction with in-vehicle technology

Cognitive performance models have been used in several human factors domains such as driving and human-computer interaction. However, most models are limited to expert performance with rough adjustments to consider novices despite prior studies suggesting novices' cognitive, perceptual, and motor behaviors are different from experts. The objective of this study was to develop a cognitive performance model for novice law enforcement officers (N-CPM) to model their performance and memory load while interacting with in-vehicle technology. The model was validated based on a ride-along study with 10 novice law enforcement officers (nLEOs). The findings suggested that there were no significant differences between the N-CPM and observation data in most cases, while the results of the benchmark model were different from that of N-CPM. The model can be applied to improve future nLEO's patrol mission performance through redesigning in-vehicle technologies and training methods to reduce their workload and driving distraction.

Ignoring the alternatives: The N400 is sensitive to stimulus preactivation alone

The N400 component of the event-related brain potential is a neural signal of processing difficulty. In the language domain, it is widely believed to be sensitive to the degree to which a given word or its semantic features have been preactivated in the brain based on the preceding context. However, it has also been shown that the brain often preactivates many words in parallel. It is currently unknown whether the N400 is also affected by the preactivations of alternative words other than the stimulus that is actually presented. This leaves a weak link in the derivation chain-how can we use the N400 to understand the mechanisms of preactivation if we do not know what it indexes? This study directly addresses this gap. We estimate the extent to which all words in a lexicon are preactivated in a given context using the predictions of contemporary large language models. We then directly compare two competing possibilities: that the amplitude of the N400 is sensitive only to the extent to which the stimulus is preactivated, and that it is also sensitive to the preactivation states of the alternatives. We find evidence of the former. This result allows for better grounded inferences about the mechanisms underlying the N400, lexical preactivation in the brain, and language processing more generally.

What is the airspeed velocity of an unladen swallow? modeling numerical judgments of realistic stimuli

Research on processes of multiple-cue judgments usually uses artificial stimuli with predefined cue structures, such as artificial bugs with four binary features like back color, belly color, gland size, and spot shape. One reason for using artifical stimuli is that the cognitive models used in this area need known cues and cue values. This limitation makes it difficult to apply the models to research questions with complex naturalistic stimuli with unknown cue structure. In two studies, building on early categorization research, we demonstrate how cues and cue values of complex naturalistic stimuli can be extracted from pairwise similarity ratings with a multidimensional scaling analysis. These extracted cues can then be used in a state-of-the-art hierarchical Bayesian model of numerical judgments. In the first study, we show that predefined cue structures of artificial stimuli are well recovered by an MDS analysis of similarity judgments and that using these MDS-based attributes as cues in a cognitive model of judgment data from an existing experiment leads to the same inferences as when the original cue values were used. In the second study, we use the same procedure to replicate previous findings from multiple-cue judgment literature using complex naturalistic stimuli.

Advancing Naturalistic Affective Science with Deep Learning

People express their own emotions and perceive others' emotions via a variety of channels, including facial movements, body gestures, vocal prosody, and language. Studying these channels of affective behavior offers insight into both the experience and perception of emotion. Prior research has predominantly focused on studying individual channels of affective behavior in isolation using tightly controlled, non-naturalistic experiments. This approach limits our understanding of emotion in more naturalistic contexts where different channels of information tend to interact. Traditional methods struggle to address this limitation: manually annotating behavior is time-consuming, making it infeasible to do at large scale; manually selecting and manipulating stimuli based on hypotheses may neglect unanticipated features, potentially generating biased conclusions; and common linear modeling approaches cannot fully capture the complex, nonlinear, and interactive nature of real-life affective processes. In this methodology review, we describe how deep learning can be applied to address these challenges to advance a more naturalistic affective science. First, we describe current practices in affective research and explain why existing methods face challenges in revealing a more naturalistic understanding of emotion. Second, we introduce deep learning approaches and explain how they can be applied to tackle three main challenges: quantifying naturalistic behaviors, selecting and manipulating naturalistic stimuli, and modeling naturalistic affective processes. Finally, we describe the limitations of these deep learning methods, and how these limitations might be avoided or mitigated. By detailing the promise and the peril of deep learning, this review aims to pave the way for a more naturalistic affective science.

Heterogeneity of rules in Bayesian reasoning: A toolbox analysis

How do people infer the Bayesian posterior probability from stated base rate, hit rate, and false alarm rate? This question is not only of theoretical relevance but also of practical relevance in medical and legal settings. We test two competing theoretical views: single-process theories versus toolbox theories. Single-process theories assume that a single process explains people's inferences and have indeed been observed to fit people's inferences well. Examples are Bayes's rule, the representativeness heuristic, and a weighing-and-adding model. Their assumed process homogeneity implies unimodal response distributions. Toolbox theories, in contrast, assume process heterogeneity, implying multimodal response distributions. After analyzing response distributions in studies with laypeople and professionals, we find little support for the single-process theories tested. Using simulations, we find that a single process, the weighing-and-adding model, nevertheless can best fit the aggregate data and, surprisingly, also achieve the best out-of-sample prediction even though it fails to predict any single respondent's inferences. To identify the potential toolbox of rules, we test how well candidate rules predict a set of over 10,000 inferences (culled from the literature) from 4,188 participants and 106 different Bayesian tasks. A toolbox of five non-Bayesian rules plus Bayes's rule captures 64% of inferences. Finally, we validate the Five-Plus toolbox in three experiments that measure response times, self-reports, and strategy use. The most important conclusion from these analyses is that the fitting of single-process theories to aggregate data risks misidentifying the cognitive process. Antidotes to that risk are careful analyses of process and rule heterogeneity across people.

Testing three coping strategies for time pressure in categorizations and similarity judgments

This article compares three psychological mechanisms to make multi-attribute inferences under time pressure in the domains of categorization and similarity judgments. Specifically, we test if people under time pressure attend to fewer object features (attention focus), if they respond less precisely (lower choice sensitivity), or if they simplify a psychological similarity function (simplified similarity). The simpler psychological similarity considers the number of matching features but ignores the actual feature value differences. We conducted three experiments (two of them preregistered) in which we manipulated time pressure: one was a categorization task, which was designed based on optimal experimental design principles, and the other two involved a similarity judgment task. Computational cognitive modeling following an exemplar-similarity framework showed that the behavior of most participants under time pressure is in line with a lower choice sensitivity, this means less precise response selection, especially when people make similarity judgments. We find that the variability of participants' behavior increases with time pressure, to a point where participants are unlikely to make inferences anymore but instead start choosing readily available response options repeatedly. These findings are consistent with related research in other cognitive domains, such as risky choices, and add to growing evidence that time pressure and other forms of cognitive load do not necessarily alter core cognitive processes themselves but rather affect the precision of response selection.

Uncertainty maximization in partially observable domains: A cognitive perspective

Faced with an ever-increasing complexity of their domains of application, artificial learning agents are now able to scale up in their ability to process an overwhelming amount of data. However, this comes at the cost of encoding and processing an increasing amount of redundant information. This work exploits the possibility of learning systems, applied in partially observable domains, to selectively focus on the specific type of information that is more likely related to the causal interaction among transitioning states. A temporal difference displacement criterion is defined to implement adaptive masking of the observations. It can enable a significant improvement of convergence of temporal difference algorithms applied to partially observable Markov processes, as shown by experiments performed under a variety of machine learning problems, ranging from highly complex visuals as Atari games to simple textbook control problems such as CartPole. The proposed framework can be added to most RL algorithms since it only affects the observation process, selecting the parts more promising to explain the dynamics of the environment and reducing the dimension of the observation space.

How do Humans Overcome Individual Computational Limitations by Working Together?

Since the cognitive revolution, psychologists have developed formal theories of cognition by thinking about the mind as a computer. However, this metaphor is typically applied to individual minds. Humans rarely think alone; compared to other animals, humans are curiously dependent on stores of culturally transmitted skills and knowledge, and we are particularly good at collaborating with others. Rather than picturing the human mind as an isolated computer, we can imagine each mind as a node in a vast distributed system. Viewing human cognition through the lens of distributed systems motivates new questions about how humans share computation, when it makes sense to do so, and how we can build institutions to facilitate collaboration.

Capturing Dynamic Performance in a Cognitive Model: Estimating ACT-R Memory Parameters With the Linear Ballistic Accumulator

The parameters governing our behavior are in constant flux. Accurately capturing these dynamics in cognitive models poses a challenge to modelers. Here, we demonstrate a mapping of ACT-R's declarative memory onto the linear ballistic accumulator (LBA), a mathematical model describing a competition between evidence accumulation processes. We show that this mapping provides a method for inferring individual ACT-R parameters without requiring the modeler to build and fit an entire ACT-R model. Existing parameter estimation methods for the LBA can be used, instead of the computationally expensive parameter sweeps that are traditionally done. We conduct a parameter recovery study to confirm that the LBA can recover ACT-R parameters from simulated data. Then, as a proof of concept, we use the LBA to estimate ACT-R parameters from an empirical dataset. The resulting parameter estimates provide a cognitively meaningful explanation for observed differences in behavior over time and between individuals. In addition, we find that the mapping between ACT-R and LBA lends a more concrete interpretation to ACT-R's latency factor parameter, namely as a measure of response caution. This work contributes to a growing movement towards integrating formal modeling approaches in cognitive science.

Editors' Introduction: Best Papers from the 19th International Conference on Cognitive Modeling

The International Conference on Cognitive Modeling brings together researchers from around the world whose main goal is to build computational systems that reflect the internal processes of the mind. In this issue, we present the five best representative papers on this work from our 19th meeting, ICCM 2021, which was held virtually from July 3 to July 9, 2021. Three of these papers provide new techniques for refining computational models, giving better methods for taking empirical data and producing accurate computational models of the cognitive systems that produce them. The other two papers focus on explanation: using models to elucidate the underlying processes affecting cognition in such diverse domains as logical reasoning and the effects of caffeine.

Inferring a Cognitive Architecture from Multitask Neuroimaging Data: A Data-Driven Test of the Common Model of Cognition Using Granger Causality

Cognitive architectures (i.e., theorized blueprints on the structure of the mind) can be used to make predictions about the effect of multiregion brain activity on the systems level. Recent work has connected one high-level cognitive architecture, known as the "Common Model of Cognition," to task-based functional MRI data with great success. That approach, however, was limited in that it was intrinsically top-down, and could thus only be compared with alternate architectures that the experimenter could contrive. In this paper, we propose a bottom-up method to infer a cognitive architecture directly from brain imaging data itself, overcoming this limitation. Specifically, Granger causality modeling was applied to the same task-based fMRI data to infer a network of causal connections between brain regions based on their functional connectivity. The resulting network shares many connections with those proposed by the Common Model of Cognition but also suggests important additions likely related to the role of episodic memory. This combined top-down and bottom-up modeling approach can be used to help formalize the computational instantiation of cognitive architectures and further refine a comprehensive theory of cognition.

Model-Based Explanation of Feedback Effects in Syllogistic Reasoning

For decades, a significant number of models explaining human syllogistic inference processes were developed. There is profound work fitting the models' parameters and analyzing each model's ability to account for the data in order to support or reject the underlying theories. However, the model parameters are rarely used to extract explanations and hypotheses for phenomena that go beyond the original scope of the models. In this work, we apply three state-of-the-art models,  the probability heuristics model (PHM), mReasoner, and TransSet, to data from reasoning experiments where participants received feedback for their conclusions. We derived hypotheses based on the models' explanations for the feedback effect and put these to the test by conducting an experiment targeting the hypotheses. The work contributes to the field in three ways: (a) the feedback effect could be replicated and was shown to be a robust effect; (b) we demonstrate the use of the model parameters in order to derive new hypotheses; (c) we present possible explanations for the feedback effect based on existing theories.

Unraveling the cognitive correlates of heart rate variability with the drift diffusion model

The Neurovisceral Integration Model posits a link between resting vagally mediated heart rate variability (vmHRV) and cognitive control. Empirical support for this link is mixed, potentially due to coarse performance metrics such as mean response time (RT). To clarify this issue, we tested the relationships between resting vmHRV and refined estimates of cognitive control- as revealed by the ex-Gaussian model of RT and, to a greater extent, the drift diffusion model (DDM, a computational model of two-choice performance). Participants (N = 174) completed a five-minute resting baseline while ECG was collected followed by a Simon spatial conflict task. The root mean square of successive differences in interbeat intervals was calculated to index resting vmHRV. Resting vmHRV was unrelated to Simon's mean RT and accuracy rates, but was inversely related to the ex-Gaussian parameter reflecting slow RTs (tau); however, this finding was attenuated after adjustment for covariates. High resting vmHRV was related to faster drift rates and slower non-decision times, DDM parameters reflecting goal-directed cognition and sensorimotor processes, respectively. The DDM effects survived covariate adjustment and were specific to incongruent trials (i.e., when cognitive control demands were high). Findings suggest a link between vmHRV and cognitive control vis-a-vis drift rate, and potentially, a link between vmHRV and motoric inhibition vis-a-vis non-decision time. These cognitive correlates would have been missed with reliance on traditional performance. Findings are discussed with respect to the inhibitory processes that promote effective performance in high vmHRV individuals.

Resource-rational Models of Human Goal Pursuit

Goal-directed behavior is a deeply important part of human psychology. People constantly set goals for themselves and pursue them in many domains of life. In this paper, we develop computational models that characterize how humans pursue goals in a complex dynamic environment and test how well they describe human behavior in an experiment. Our models are motivated by the principle of resource rationality and draw upon psychological insights about people's limited attention and planning capacities. We find that human goal pursuit is qualitatively different and substantially less efficient than optimal goal pursuit in our simulated environment. Models of goal pursuit based on the principle of resource rationality capture human behavior better than both a model of optimal goal pursuit and heuristics that are not resource-rational. We conclude that the way humans pursue goals is shaped by the need to achieve goals effectively as well as cognitive costs and constraints on planning and attention. Our findings are an important step toward understanding humans' goal pursuit as cognitive limitations play a crucial role in shaping people's goal-directed behavior.

A number-line task with a Bayesian active learning algorithm provides insights into the development of non-symbolic number estimation

To characterize numerical representations, the number-line task asks participants to estimate the location of a given number on a line flanked with zero and an upper-bound number. An open question is whether estimates for symbolic numbers (e.g., Arabic numerals) and non-symbolic numbers (e.g., number of dots) rely on common processes with a common developmental pathway. To address this question, we explored whether well-established findings in symbolic number-line estimation generalize to non-symbolic number-line estimation. For exhaustive investigations without sacrificing data quality, we applied a novel Bayesian active learning algorithm, dubbed Gaussian process active learning (GPAL), that adaptively optimizes experimental designs. The results showed that the non-symbolic number estimation in participants of diverse ages (5-73 years old, n = 238) exhibited three characteristic features of symbolic number estimation.

An Analogical Model of Pretense

We argue that pretense can be viewed as analogical projection: a structural comparison between the pretend scenario and its real-world counterpart that leads to inferences about the pretend scenario. For example, in pretending to make a phone call with a banana, a number pad might be projected on the banana's surface. We model two empirical studies of early childhood pretense, and show how successful pretense requires making and accepting such inferences, while failed pretense can be traced to failure of such projection. Other models of pretense, both theoretical and computational, and their relationships to our model, are discussed.

Cognitive and neural principles of a memory bias on preferential choices

Value-based decisions depend on different forms of memory. However, the respective roles of memory and valuation processes that give rise to these decisions are often vaguely described and have rarely been investigated jointly. In this review article, we address the problem of memory-based decision making from a neuroeconomic perspective. We first describe the neural and cognitive processes involved in decisions requiring memory processes, with a focus on episodic memory. Based on the results of a systematic research program, we then spotlight the phenomenon of the memory bias, a general preference for choice options that can be retrieved from episodic memory more successfully. Our findings indicate that failed memory recall biases neural valuation processes as indicated by altered effective connectivity between the hippocampus and ventromedial prefrontal cortex. This bias can be attributed to meta-cognitive beliefs about the relationship between subjective value and memory as well as to uncertainty aversion. After summarizing the findings, we outline potential future research endeavors to integrate the two research traditions of memory and decision making.

Modeling and predicting individual tacit coordination ability

Background

Previous experiments in tacit coordination games hinted that some people are more successful in achieving coordination than others, although the variability in this ability has not yet been examined before. With that in mind, the overarching aim of our study is to model and describe the variability in human decision-making behavior in the context of tacit coordination games.

Methods

In this study, we conducted a large-scale experiment to collect behavioral data, characterized the distribution of tacit coordination ability, and modeled the decision-making behavior of players. First, we measured the multimodality in the data and described it by using a Gaussian mixture model. Then, using multivariate linear regression and dimensionality reduction (PCA), we have constructed a model linking between individual strategic profiles of players and their coordination ability. Finally, we validated the predictive performance of the model by using external validation.

Results

We demonstrated that coordination ability is best described by a multimodal distribution corresponding to the levels of coordination ability and that there is a significant relationship between the player’s strategic profile and their coordination ability. External validation determined that our predictive model is robust.

Conclusions

The study provides insight into the amount of variability that exists in individual tacit coordination ability as well as in individual strategic profiles and shows that both are quite diverse. Our findings may facilitate the construction of improved algorithms for human–machine interaction in diverse contexts. Additional avenues for future research are discussed.

An exploration of error-driven learning in simple two-layer networks from a discriminative learning perspective

Error-driven learning algorithms, which iteratively adjust expectations based on prediction error, are the basis for a vast array of computational models in the brain and cognitive sciences that often differ widely in their precise form and application: they range from simple models in psychology and cybernetics to current complex deep learning models dominating discussions in machine learning and artificial intelligence. However, despite the ubiquity of this mechanism, detailed analyses of its basic workings uninfluenced by existing theories or specific research goals are rare in the literature. To address this, we present an exposition of error-driven learning – focusing on its simplest form for clarity – and relate this to the historical development of error-driven learning models in the cognitive sciences. Although historically error-driven models have been thought of as associative, such that learning is thought to combine preexisting elemental representations, our analysis will highlight the discriminative nature of learning in these models and the implications of this for the way how learning is conceptualized. We complement our theoretical introduction to error-driven learning with a practical guide to the application of simple error-driven learning models in which we discuss a number of example simulations, that are also presented in detail in an accompanying tutorial.

Cognitive Modeling of Anticipation: Unsupervised Learning and Symbolic Modeling of Pilots' Mental Representations

The ability to anticipate team members' actions enables joint action towards a common goal. Task knowledge and mental simulation allow for anticipating other agents' actions and for making inferences about their underlying mental representations. In human-AI teams, providing AI agents with anticipatory mechanisms can facilitate collaboration and successful execution of joint action. This paper presents a computational cognitive model demonstrating mental simulation of operators' mental models of a situation and anticipation of their behavior. The work proposes two successive steps: (1) A hierarchical cluster algorithm is applied to recognize patterns of behavior among pilots. These behavioral clusters are used to derive commonalities in situation models from empirical data (N = 13 pilots). (2) An ACT-R (adaptive control of thought - rational) cognitive model is implemented to mentally simulate different possible outcomes of action decisions and timing of a pilot. model tracing of ACT-R allows following up on operators' individual actions. Two models are implemented using the symbolic representations of ACT-R: one simulating normative behavior and the other by simulating individual differences and using subsymbolic learning. Model performance is analyzed by a comparison of both models. Results indicate the improved performance of the individual differences over the normative model and are discussed regarding implications for cognitive assistance capable of anticipating operator behavior.

The Natural Stories corpus: a reading-time corpus of English texts containing rare syntactic constructions

It is now a common practice to compare models of human language processing by comparing how well they predict behavioral and neural measures of processing difficulty, such as reading times, on corpora of rich naturalistic linguistic materials. However, many of these corpora, which are based on naturally-occurring text, do not contain many of the low-frequency syntactic constructions that are often required to distinguish between processing theories. Here we describe a new corpus consisting of English texts edited to contain many low-frequency syntactic constructions while still sounding fluent to native speakers. The corpus is annotated with hand-corrected Penn Treebank-style parse trees and includes self-paced reading time data and aligned audio recordings. We give an overview of the content of the corpus, review recent work using the corpus, and release the data.

Distributional social semantics: Inferring word meanings from communication patterns

Distributional models of lexical semantics have proven to be powerful accounts of how word meanings are acquired from the natural language environment (Günther, Rinaldi, & Marelli, 2019; Kumar, 2020). Standard models of this type acquire the meaning of words through the learning of word co-occurrence statistics across large corpora. However, these models ignore social and communicative aspects of language processing, which is considered central to usage-based and adaptive theories of language (Tomasello, 2003; Beckner et al., 2009). Johns (2021) recently demonstrated that integrating social and communicative information into a lexical strength measure allowed for benchmark fits to be attained for lexical organization data, indicating that the social world contains important statistical information for language learning and processing. Through the analysis of the communication patterns of over 330,000 individuals on the online forum Reddit, totaling approximately 55 billion words of text, the findings of the current article demonstrates that social information about word usage allows for unique aspects of a word's meaning to be acquired, providing a new pathway for distributional model development.

How Children Process Reduced Forms: A Computational Cognitive Modeling Approach to Pronoun Processing in Discourse

Reduced forms such as the pronoun he provide little information about their intended meaning compared to more elaborate descriptions such as the lead singer of Coldplay. Listeners must therefore use contextual information to recover their meaning. Across languages, there appears to be a trade-off between the informativity of a form and the prominence of its referent. For example, Italian adults generally interpret informationally empty null pronouns as in the sentence Corre (meaning "He/She/It runs") as referring to the most prominent referent in the discourse, and more informative overt pronouns (e.g., lui in Lui corre, "He runs") as referring to less prominent referents. Although children acquiring Italian are known to experience difficulties interpreting pronouns, it is unclear how they acquire this division of pragmatic labor between null and overt subject pronouns, and how this relates to the development of their cognitive capacities. Here we show that cognitive development can account for the general interpretation patterns displayed by Italian-speaking children and adults. Using experimental studies and computational simulations in a framework modeling bounded-rational behavior, we argue that null pronoun interpretation is influenced by working memory capacity and thus appears to depend on discourse context, whereas overt pronoun interpretation is influenced by processing speed, suggesting that listeners must reason about the speaker's choices. Our results demonstrate that cognitive capacities may constrain the acquisition of linguistic forms and their meanings in various ways. The novel predictions generated by the computational simulations point out several directions for future research.

Toward a Psychology of Deep Reinforcement Learning Agents Using a Cognitive Architecture

We argue that cognitive models can provide a common ground between human users and deep reinforcement learning (Deep RL) algorithms for purposes of explainable artificial intelligence (AI). Casting both the human and learner as cognitive models provides common mechanisms to compare and understand their underlying decision-making processes. This common grounding allows us to identify divergences and explain the learner's behavior in human understandable terms. We present novel salience techniques that highlight the most relevant features in each model's decision-making, as well as examples of this technique in common training environments such as Starcraft II and an OpenAI gridworld.

Editors' Introduction: Best Papers from the 18th International Conference on Cognitive Modeling

The International Conference on Cognitive Modeling brings together researchers from around the world whose main goal is to build computational systems that reflect the internal processes of the mind. In this issue, we present the four best representative papers on this work from our 18th meeting, ICCM 2020, which was also the first meeting to be held virtually. Two of these papers develop novel techniques for building larger and more complex models using Reinforcement Learning and Learning By Instruction, respectively. The other two show how cognitive models connect to neuroscience, drawing on details of the hippocampus and cerebellum to constrain and explain the cognitive processes involved in memory and conditioning.

The simultaneous recognition of multiple words: A process analysis

In everyday life, recognition decisions often have to be made for multiple objects simultaneously. In contrast, research on recognition memory has predominantly relied on single-item recognition paradigms. We present a first systematic investigation into the cognitive processes that differ between single-word and paired-word tests of recognition memory. In a single-word test, participants categorize previously presented words and new words as having been studied before (old) or not (new). In a paired-word test, however, the test words are randomly paired, and participants provide joint old-new categorizations of both words for each pair. Across two experiments (N = 170), we found better memory performance for words tested singly rather than in pairs and, more importantly, dependencies between the two single-word decisions implied by the paired-word test. We extended two popular model classes of single-item recognition to paired-word recognition, a discrete-state model and a continuous model. Both models attribute performance differences between single-word and paired-word recognition to differences in memory-evidence strength. Discrete-state models account for the dependencies in paired-word decisions in terms of dependencies in guessing. In contrast, continuous models map the dependencies on mnemonic (Experiment 1 & 2) as well as on decisional processes (Experiment 2). However, in both experiments, model comparison favored the discrete-state model, indicating that memory decisions for word pairs seem to be mediated by discrete states. Our work suggests that individuals tackle multiple-item recognition fundamentally differently from single-item recognition, and it provides both a behavioral and model-based paradigm for studying multiple-item recognition.

How Do Gain and Loss Incentives Affect Memory for Intentions Across Adulthood?

OBJECTIVES

Changes in motivational orientation across adulthood affect cognitive processes. The purpose of this research was to investigate if and how motivational incentives (gains or losses) affect prospective memory for intended actions in younger, middle-aged, and older adults.

METHODS

The consequences of memory hits and misses and the framing of the memory tasks were experimentally manipulated between participants: In a gain-framing condition, participants accumulated rewards, dependent on the proportion of target events to which they responded accurately. In a loss-framing condition, participants received an initial endowment from which losses were deducted, dependent on the proportion of targets they missed. We measured memory accuracy, perceived task importance, and ongoing-task performance.

RESULTS

Gains and losses had different effects on memory across age groups: Age × Motivational Valence interactions emerged across two studies. Older adults showed relatively better memory performance to avoid losses than to achieve gains. Moreover, higher age was associated with lower memory performance (Study 1) and slower but more accurate decisions in an ongoing activity (Study 2).

DISCUSSION

The findings reveal that motivational incentives and the framing of consequences as gains or losses moderate the relation between age and memory performance. Older adults' memory performance may benefit when messages encourage the avoidance of losses. This may also help to design age-tailored interventions in applied settings (e.g., health-related behavior).

Cognitive models of optimal sequential search with recall

Many everyday decisions require sequential search, according to which available choice options are observed one at a time, with each observation involving some cost to the decision maker. In these tasks, decision makers need to trade-off the chances of finding better options with the cost of search. Optimal strategies in such tasks involve threshold decision rules, which terminate the search as soon as an option exceeding a reward value is found. Threshold rules can be seen as special cases of well-known algorithmic decision processes, such as the satisficing heuristic. Prior work has found that decision makers do use threshold rules, however the stopping thresholds observed in data are typically smaller than the (expected value maximizing) optimal threshold. We put forward an array of cognitive models and use parametric model fits on participant-level search data to examine why decision makers adopt seemingly suboptimal thresholds. We find that people's behavior is consistent with optimal search if we allow participants to display risk aversion, psychological effort cost, and decision error. Thus, decision makers appear to be able to search in a resource-rational manner that maximizes stochastic risk averse utility. Our findings shed light on the psychological factors that guide sequential decision making, and show how threshold models can be used to describe both computational and algorithmic aspects of search behavior.

A Bayesian brain model of adaptive behavior: an application to the Wisconsin Card Sorting Task

Adaptive behavior emerges through a dynamic interaction between cognitive agents and changing environmental demands. The investigation of information processing underlying adaptive behavior relies on controlled experimental settings in which individuals are asked to accomplish demanding tasks whereby a hidden regularity or an abstract rule has to be learned dynamically. Although performance in such tasks is considered as a proxy for measuring high-level cognitive processes, the standard approach consists in summarizing observed response patterns by simple heuristic scoring measures. With this work, we propose and validate a new computational Bayesian model accounting for individual performance in the Wisconsin Card Sorting Test (WCST), a renowned clinical tool to measure set-shifting and deficient inhibitory processes on the basis of environmental feedback. We formalize the interaction between the task's structure, the received feedback, and the agent's behavior by building a model of the information processing mechanisms used to infer the hidden rules of the task environment. Furthermore, we embed the new model within the mathematical framework of the Bayesian Brain Theory (BBT), according to which beliefs about hidden environmental states are dynamically updated following the logic of Bayesian inference. Our computational model maps distinct cognitive processes into separable, neurobiologically plausible, information-theoretic constructs underlying observed response patterns. We assess model identification and expressiveness in accounting for meaningful human performance through extensive simulation studies. We then validate the model on real behavioral data in order to highlight the utility of the proposed model in recovering cognitive dynamics at an individual level. We highlight the potentials of our model in decomposing adaptive behavior in the WCST into several information-theoretic metrics revealing the trial-by-trial unfolding of information processing by focusing on two exemplary individuals whose behavior is examined in depth. Finally, we focus on the theoretical implications of our computational model by discussing the mapping between BBT constructs and functional neuroanatomical correlates of task performance. We further discuss the empirical benefit of recovering the assumed dynamics of information processing for both clinical and research practices, such as neurological assessment and model-based neuroscience.

Modeling across-trial variability in the Wald drift rate parameter

The shifted-Wald model is a popular analysis tool for one-choice reaction-time tasks. In its simplest version, the shifted-Wald model assumes a constant trial-independent drift rate parameter. However, the presence of endogenous processes—fluctuation in attention and motivation, fatigue and boredom—suggest that drift rate might vary across experimental trials. Here we show how across-trial variability in drift rate can be accounted for by assuming a trial-specific drift rate parameter that is governed by a positive-valued distribution. We consider two candidate distributions: the truncated normal distribution and the gamma distribution. For the resulting distributions of first-arrival times, we derive analytical and sampling-based solutions, and implement the models in a Bayesian framework. Recovery studies and an application to a data set comprised of 1469 participants suggest that (1) both mixture distributions yield similar results; (2) all model parameters can be recovered accurately except for the drift variance parameter; (3) despite poor recovery, the presence of the drift variance parameter facilitates accurate recovery of the remaining parameters; (4) shift, threshold, and drift mean parameters are correlated.

Memory-related cognitive load effects in an interrupted learning task: A model-based explanation

BACKGROUND

The Cognitive Load Theory provides a well-established framework for investigating aspects of learning situations that demand learners' working memory resources. However, the interplay of these aspects at the cognitive and neural level is still not fully understood.

METHOD

We developed four computational models in the cognitive architecture ACT-R to clarify underlying memory-related strategies and mechanisms. Our models account for human data of an experiment that required participants to perform a symbol sequence learning task with embedded interruptions. We explored the inclusion of subsymbolic mechanisms to explain these data and used our final model to generate fMRI predictions.

RESULTS

The final model indicates a reasonable fit for reaction times and accuracy and links the fMRI predictions to the Cognitive Load Theory.

CONCLUSIONS

Our work emphasizes the influence of task characteristics and supports a process-related view on cognitive load in instructional scenarios. It further contributes to the discussion of underlying mechanisms at a neural level.

ADOpy: a python package for adaptive design optimization

Experimental design is fundamental to research, but formal methods to identify good designs are lacking. Advances in Bayesian statistics and machine learning offer algorithm-based ways to identify good experimental designs. Adaptive design optimization (ADO; Cavagnaro, Myung, Pitt, & Kujala, 2010; Myung, Cavagnaro, & Pitt, 2013) is one such method. It works by maximizing the informativeness and efficiency of data collection, thereby improving inference. ADO is a general-purpose method for conducting adaptive experiments on the fly and can lead to rapid accumulation of information about the phenomenon of interest with the fewest number of trials. The nontrivial technical skills required to use ADO have been a barrier to its wider adoption. To increase its accessibility to experimentalists at large, we introduce an open-source Python package, ADOpy, that implements ADO for optimizing experimental design. The package, available on GitHub, is written using high-level modular-based commands such that users do not have to understand the computational details of the ADO algorithm. In this paper, we first provide a tutorial introduction to ADOpy and ADO itself, and then illustrate its use in three walk-through examples: psychometric function estimation, delay discounting, and risky choice. Simulation data are also provided to demonstrate how ADO designs compare with other designs (random, staircase).

Editor's Introduction: Best of Papers From the 17th International Conference on Cognitive Modeling

Cognitive modeling involves the creation of computer simulations that emulate the internal processes of the mind. This set of papers are the five best representatives of the papers presented at the 17th International Conference on Cognitive Modeling, ICCM 2019. While they represent a diversity of techniques and tasks, they all also share a striking similarity: They make strong statements about the importance of accounting for individual differences.

The Role of Basal Ganglia Reinforcement Learning in Lexical Ambiguity Resolution

The current study aimed to elucidate the contributions of the subcortical basal ganglia to human language by adopting the view that these structures engage in a basic neurocomputation that may account for its involvement across a wide range of linguistic phenomena. Specifically, we tested the hypothesis that basal ganglia reinforcement learning (RL) mechanisms may account for variability in semantic selection processes necessary for ambiguity resolution. To test this, we used a biased homograph lexical ambiguity priming task that allowed us to measure automatic processes for resolving ambiguity toward high-frequency word meanings. Individual differences in task performance were then related to indices of basal ganglia RL, which were used to group subjects into three learning styles: (a) Choosers who learn by seeking high reward probability stimuli; (b) Avoiders, who learn by avoiding low reward probability stimuli; and (c) Balanced participants, whose learning reflects equal contributions of choose and avoid processes. The results suggest that balanced individuals had significantly lower access to subordinate, or low-frequency, homograph word meanings. Choosers and Avoiders, on the other hand, had higher access to the subordinate word meaning even after a long delay between prime and target. Experimental findings were then tested using an ACT-R computational model of RL that learns from both positive and negative feedback. Results from the computational model simulations confirm and extend the pattern of behavioral findings, providing an RL account of individual differences in lexical ambiguity resolution.

Modeling Human Syllogistic Reasoning: The Role of "No Valid Conclusion"

Syllogistic reasoning, that is the drawing of inferences for categorical-quantified assertions, is one of the oldest branches of deductive reasoning research with a history exceeding 100 years. In syllogistic reasoning experiments, "No Valid Conclusion" (NVC) is one of the most frequently selected responses and corresponds to the logically correct conclusion for 58% of the syllogistic problem domain. To date, NVC is often neglected in computational models or just treated as a by-product of the underlying inferential mechanisms such as a last resort when the search for alternatives is exhausted. We illustrate that NVC represents a major shortcoming of current models for human syllogistic reasoning. By introducing heuristic rules for predicting NVC, we demonstrate that simple extensions of the existing models result in substantial improvements in their predictive performances. Our results emphasize the need for better NVC handling in cognitive modeling of human reasoning and provide directions for modelers on how to enhance their approaches.

Obtaining psychological embeddings through joint kernel and metric learning

Psychological embeddings provide a powerful formalism for characterizing human-perceived similarity among members of a stimulus set. Obtaining high-quality embeddings can be costly due to algorithm design, software deployment, and participant compensation. This work aims to advance state-of-the-art embedding techniques and provide a comprehensive software package that makes obtaining high-quality psychological embeddings both easy and relatively efficient. Contributions are made on four fronts. First, the embedding procedure allows multiple trial configurations (e.g., triplets) to be used for collecting similarity judgments from participants. For example, trials can be configured to collect triplet comparisons or to sort items into groups. Second, a likelihood model is provided for three classes of similarity kernels allowing users to easily infer the parameters of their preferred model using gradient descent. Third, an active selection algorithm is provided that makes data collection more efficient by proposing comparisons that provide the strongest constraints on the embedding. Fourth, the likelihood model allows the specification of group-specific attention weight parameters. A series of experiments are included to highlight each of these contributions and their impact on converging to a high-quality embedding. Collectively, these incremental improvements provide a powerful and complete set of tools for inferring psychological embeddings. The relevant tools are available as the Python package PsiZ, which can be cloned from GitHub ( https://github.com/roads/psiz ).

A computational model of the Cambridge gambling task with applications to substance use disorders

BACKGROUND

Impulsivity is central to all forms of externalizing psychopathology, including problematic substance use. The Cambridge Gambling task (CGT) is a popular neurocognitive task used to assess impulsivity in both clinical and healthy populations. However, the traditional methods of analysis in the CGT do not fully capture the multiple cognitive mechanisms that give rise to impulsive behavior, which can lead to underpowered and difficult-to-interpret behavioral measures.

OBJECTIVES

The current study presents the cognitive modeling approach as an alternative to traditional methods and assesses predictive and convergent validity across and between approaches.

METHODS

We used hierarchical Bayesian modeling to fit a series of cognitive models to data from healthy controls (N = 124) and individuals with histories of substance use disorders (Heroin: N = 79; Amphetamine: N = 76; Polysubstance: N = 103; final total across groups N = 382). Using Bayesian model comparison, we identified the best fitting model, which was then used to identify differences in cognitive model parameters between groups.

RESULTS

The cognitive modeling approach revealed differences in quality of decision making and impulsivity between controls and individuals with substance use disorders that traditional methods alone did not detect. Crucially, convergent validity between traditional measures and cognitive model parameters was strong across all groups.

CONCLUSION

The cognitive modeling approach is a viable method of measuring the latent mechanisms that give rise to choice behavior in the CGT, which allows for stronger statistical inferences and a better understanding of impulsive and risk-seeking behavior.

Model-based assessment and neural correlates of spatial memory deficits in mild cognitive impairment

Mild cognitive impairment (MCI) is characterized by subjective and objective memory impairments within the context of generally intact everyday functioning. Such memory deficits are typically thought to arise from medial temporal lobe dysfunction; however, differences in memory task performance can arise from a variety of altered processes (e.g., strategy adjustments) rather than, or in addition to, "pure" memory deficits. To address this problem, we applied the linear ballistic accumulator (LBA: Brown and Heathcote, 2008) model to data from individuals with MCI (n = 18) and healthy older adults (HOA; n = 16) who performed an object-location association memory retrieval task during functional magnetic resonance imaging (fMRI). The primary goals were to 1) assess between-group differences in model parameters indexing processes of interest (memory sensitivity, accumulation speed, caution and time spent on peripheral perceptual and motor processes) and 2) determine whether differences in model-based metrics were consistent with fMRI data. The LBA provided evidence that, relative to the HOA group, those with MCI displayed lower sensitivity (i.e., difficulty discriminating targets from lures), suggestive of memory impairment, and displayed higher evidence accumulation speed and greater caution, suggestive of increased arousal and strategic changes in this group, although these changes had little impact on MCI-related accuracy differences. Consistent with these findings, fMRI revealed reduced activation in brain regions previously linked to evidence accumulation and to the implementation of caution reductions in the MCI group. Findings suggest that multiple cognitive mechanisms differ during memory retrieval in MCI, and that these mechanisms may explain neuroimaging alterations outside of the medial temporal lobes.

The Quality of Response Time Data Inference: A Blinded, Collaborative Assessment of the Validity of Cognitive Models

Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression of latent variables including 1) ease of processing, 2) response caution, 3) response bias, and 4) non-decision time. Inferences about these psychological factors, hinge upon the validity of the models’ parameters. Here, we use a blinded, collaborative approach to assess the validity of such model-based inferences. Seventeen teams of researchers analyzed the same 14 data sets. In each of these two-condition data sets, we manipulated properties of participants’ behavior in a two-alternative forced choice task. The contributing teams were blind to the manipulations, and had to infer what aspect of behavior was changed using their method of choice. The contributors chose to employ a variety of models, estimation methods, and inference procedures. Our results show that, although conclusions were similar across different methods, these "modeler’s degrees of freedom" did affect their inferences. Interestingly, many of the simpler approaches yielded as robust and accurate inferences as the more complex methods. We recommend that, in general, cognitive models become a typical analysis tool for response time data. In particular, we argue that the simpler models and procedures are sufficient for standard experimental designs. We finish by outlining situations in which more complicated models and methods may be necessary, and discuss potential pitfalls when interpreting the output from response time models.

The Cognitive Architecture of Perceived Animacy: Intention, Attention, and Memory

Human vision supports social perception by efficiently detecting agents and extracting rich information about their actions, goals, and intentions. Here, we explore the cognitive architecture of perceived animacy by constructing Bayesian models that integrate domain-specific hypotheses of social agency with domain-general cognitive constraints on sensory, memory, and attentional processing. Our model posits that perceived animacy combines a bottom-up, feature-based, parallel search for goal-directed movements with a top-down selection process for intent inference. The interaction of these architecturally distinct processes makes perceived animacy fast, flexible, and yet cognitively efficient. In the context of chasing, in which a predator (the "wolf") pursues a prey (the "sheep"), our model addresses the computational challenge of identifying target agents among varying numbers of distractor objects, despite a quadratic increase in the number of possible interactions as more objects appear in a scene. By comparing modeling results with human psychophysics in several studies, we show that the effectiveness and efficiency of human perceived animacy can be explained by a Bayesian ideal observer model with realistic cognitive constraints. These results provide an understanding of perceived animacy at the algorithmic level-how it is achieved by cognitive mechanisms such as attention and working memory, and how it can be integrated with higher-level reasoning about social agency.

The Bayesian causal inference model benefits from an informed prior to predict proprioceptive drift in the rubber foot illusion

Bayesian cognitive modeling has become a prominent tool for the cognitive sciences aiming at a deeper understanding of the human mind and applications in cognitive systems, e.g., humanoid or wearable robotics. Such approaches can capture human behavior adequately with a focus on the crossmodal processing of sensory information. The rubber foot illusion is a paradigm in which such integration is relevant. After experimental stimulation, many participants perceive their real limb closer to an artificial replicate than it actually is. A measurable effect of this recalibration on localization is called the proprioceptive drift. We investigate whether the Bayesian causal inference model can estimate the proprioceptive drift observed in empirical studies. Moreover, we juxtapose two models employing informed prior distributions on limb location against an existing model assuming uniform prior distribution. The model involving empirically informed prior information yields better predictions of the proprioceptive drift regarding the rubber foot illusion when evaluated with separate experimental data. Contrary, the uniform model produces implausibly narrow position estimates that seem due to the precision ratio between the contributing sensory channels. We conclude that an informed prior on limb localization is a plausible and necessary modification to the Bayesian causal inference model when applied to limb illusions. Future research could overcome the remaining discrepancy between model predictions and empirical observation by investigating the changes in sensory precision as a function of distance between the eyes and respective limbs.

Modeling the effects of methylphenidate on interference and evidence accumulation processes using the conflict linear ballistic accumulator

RATIONALE

Although methylphenidate and other stimulants have been demonstrated to improve task performance across a variety of domains, a computationally rigorous account of how these drugs alter cognitive processing remains elusive. Recent applications of mathematical models of cognitive processing and electrophysiological methods to this question have suggested that stimulants improve the integrity of evidence accumulation processes for relevant choices, potentially through catecholaminergic modulation of neural signal-to-noise ratios. However, this nascent line of work has thus far been limited to simple perceptual tasks and has largely omitted more complex conflict paradigms that contain experimental manipulations of specific top-down interference resolution processes.

OBJECTIVES AND METHODS

To address this gap, this study applied the conflict linear ballistic accumulator (LBA), a newly proposed model designed for conflict tasks, to data from healthy adults who performed the Multi-Source Interference Task (MSIT) after acute methylphenidate or placebo challenge.

RESULTS

Model-based analyses revealed that methylphenidate improved performance by reducing individuals' response thresholds and by enhancing evidence accumulation processes across all task conditions, either by improving the quality of evidence or by reducing variability in accumulation processes. In contrast, the drug did not reduce bottom-up interference or selectively facilitate top-down interference resolution processes probed by the experimental conflict manipulation.

CONCLUSIONS

Enhancement of evidence accumulation is a biologically plausible and task-general mechanism of stimulant effects on cognition. Moreover, the assumption that methylphenidate's effects on behavior are only visible with complex executive tasks may be misguided.

Tutorial and simulations with ADAM: an adaptation and anticipation model of sensorimotor synchronization

Interpersonal coordination of movements often involves precise synchronization of action timing, particularly in expert domains such as ensemble music performance. According to the adaptation and anticipation model (ADAM) of sensorimotor synchronization, precise yet flexible interpersonal coordination is supported by reactive error correction mechanisms and anticipatory mechanisms that exploit systematic patterns in stimulus timing to plan future actions. Here, we provide a tutorial introduction to the computational architecture of ADAM and present a series of single- and dual-virtual agent simulations that examine the model parameters that produce ideal synchronization performance in different tempo conditions. In the single-agent simulations, a virtual agent synchronized responses to steady tempo sequence or a sequence containing gradual tempo changes. Parameters controlling basic reactive error (phase) correction were sufficient for producing ideal synchronization performance at the steady tempo, whereas parameters controlling anticipatory mechanisms were necessary for ideal performance with a tempo-changing sequence. In the dual-agent simulations, two interacting virtual agents produced temporal sequences from either congruent or incongruent internal performance templates specifying a steady tempo or tempo changes. Ideal performance was achieved with reactive error correction alone when both agents implemented the same performance template (either steady tempo or tempo change). In contrast, anticipatory mechanisms played a key role when one agent implemented a steady tempo template and the other agent implemented a tempo change template. These findings have implications for understanding the interplay between reactive and anticipatory mechanisms when agents possess compatible versus incompatible representations of task goals during human-human and human-machine interaction.

Thermodynamic integration via differential evolution: A method for estimating marginal likelihoods

A typical goal in cognitive psychology is to select the model that provides the best explanation of the observed behavioral data. The Bayes factor provides a principled approach for making these selections, though the integral required to calculate the marginal likelihood for each model is intractable for most cognitive models. In these cases, Monte Carlo techniques must be used to approximate the marginal likelihood, such as thermodynamic integration (TI; Friel & Pettitt, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 70(3), 589–607 2008; Lartillot & Philippe, Systematic Biology, 55(2), 195–207 2006), which relies on sampling from the posterior at different powers (called power posteriors). TI can become computationally expensive when using population Markov chain Monte Carlo (MCMC) approaches such as differential evolution MCMC (DE-MCMC; Turner et al., Psychological Methods, 18(3), 368 2013) that require several interacting chains per power posterior. Here, we propose a method called thermodynamic integration via differential evolution (TIDE), which aims to reduce the computational burden associated with TI by using a single chain per power posterior (R code available at https://osf.io/ntmgw/). We show that when applied to non-hierarchical models, TIDE produces an approximation of the marginal likelihood that closely matches TI. When extended to hierarchical models, we find that certain assumptions about the dependence between the individual- and group-level parameters samples (i.e., dependent/independent) have sizable effects on the TI approximated marginal likelihood. We propose two possible extensions of TIDE to hierarchical models, which closely match the marginal likelihoods obtained through TI with dependent/independent sampling in many, but not all, situations. Based on these findings, we believe that TIDE provides a promising method for estimating marginal likelihoods, though future research should focus on a detailed comparison between the methods of estimating marginal likelihoods for cognitive models.

Advances in techniques for imposing reciprocity in brain-behavior relations

To better understand human behavior, the emerging field of model-based cognitive neuroscience seeks to anchor psychological theory to the biological substrate from which behavior originates: the brain. Despite complex dynamics, many researchers in this field have demonstrated that fluctuations in brain activity can be related to fluctuations in components of cognitive models, which instantiate psychological theories. In this review, we discuss a number of approaches for relating brain activity to cognitive models, and expand on a framework for imposing reciprocity in the inference of mental operations from the combination of brain and behavioral data.