Individual differences in computational psychiatry: a review of current challenges

On the (un)reliability of common behavioral and electrophysiological measures from the stop signal task: Measures of inhibition lack stability over time

Response inhibition, the intentional stopping of planned or initiated actions, is often considered a key facet of control, impulsivity, and self-regulation. The stop signal task is argued to be the purest inhibition task we have, and it is thus central to much work investigating the role of inhibition in areas like development and psychopathology. Most of this work quantifies stopping behavior by calculating the stop signal reaction time as a measure of individual stopping latency. Individual difference studies aiming to investigate why and how stopping latencies differ between people often do this under the assumption that the stop signal reaction time indexes a stable, dispositional trait. However, empirical support for this assumption is lacking, as common measures of inhibition and control tend to show low test-retest reliability and thus appear unstable over time. The reasons for this could be methodological, where low stability is driven by measurement noise, or substantive, where low stability is driven by a larger influence of state-like and situational factors. To investigate this, we characterized the split-half and test-retest reliability of a range of common behavioral and electrophysiological measures derived from the stop signal task. Across three independent studies, different measurement modalities, and a systematic review of the literature, we found a pattern of low temporal stability for inhibition measures and higher stability for measures of manifest behavior and non-inhibitory processing. This pattern could not be explained by measurement noise and low internal consistency. Consequently, response inhibition appears to have mostly state-like and situational determinants, and there is little support for the validity of conceptualizing common inhibition measures as reflecting stable traits.

Rethinking interpersonal judgments: dopamine antagonists impact attributional dynamics

Barnby et al. investigated the effects of haloperidol, a D2/D3 dopamine antagonist, on social attributions. Using computational modeling, they demonstrate that haloperidol increases belief flexibility, reducing paranoia-like interpretations by enhancing sensitivity to social context and reducing self-relevant perspective taking, offering a mechanistic explanation for its therapeutic potential in schizophrenia.

Dynamic computational phenotyping of human cognition

Computational phenotyping has emerged as a powerful tool for characterizing individual variability across a variety of cognitive domains. An individual's computational phenotype is defined as a set of mechanistically interpretable parameters obtained from fitting computational models to behavioural data. However, the interpretation of these parameters hinges critically on their psychometric properties, which are rarely studied. To identify the sources governing the temporal variability of the computational phenotype, we carried out a 12-week longitudinal study using a battery of seven tasks that measure aspects of human learning, memory, perception and decision making. To examine the influence of state effects, each week, participants provided reports tracking their mood, habits and daily activities. We developed a dynamic computational phenotyping framework, which allowed us to tease apart the time-varying effects of practice and internal states such as affective valence and arousal. Our results show that many phenotype dimensions covary with practice and affective factors, indicating that what appears to be unreliability may reflect previously unmeasured structure. These results support a fundamentally dynamic understanding of cognitive variability within an individual.

Assessing the Longitudinal Associations Between Decision-Making Processes and Attention Problems in Early Adolescence

Cognitive functions and psychopathology develop in parallel in childhood and adolescence, but the temporal dynamics of their associations are poorly understood. The present study sought to elucidate the intertwined development of decision-making processes and attention problems using longitudinal data from late childhood (9-10 years) to mid-adolescence (11-13 years) from the Adolescent Brain Cognitive Development (ABCD) Study (n = 8918). We utilised hierarchical drift-diffusion modelling of behavioural data from the stop-signal task, parent-reported attention problems from the Child Behavior Checklist (CBCL), and multigroup univariate and bivariate latent change score models. The results showed faster drift rate was associated with lower levels of inattention at baseline, as well as a greater reduction of inattention over time. Moreover, baseline drift rate negatively predicted change in attention problems in females, and baseline attention problems negatively predicted change in drift rate. Neither response caution (decision threshold) nor encoding- and responding processes (non-decision time) were significantly associated with attention problems. There were no significant sex differences in the associations between decision-making processes and attention problems. The study supports previous findings of reduced evidence accumulation in attention problems and additionally shows that development of this aspect of decision-making plays a role in developmental changes in attention problems in youth.

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

Out of control: computational dynamic control dysfunction in stress- and anxiety-related disorders

Control theory, which has played a central role in technological progress over the last 150 years, has also yielded critical insights into biology and neuroscience. Recently, there has been a surging interest in integrating control theory with computational psychiatry. Here, we review the state of the field of using control theory approaches in computational psychiatry and show that recent research has mapped a neural control circuit consisting of frontal cortex, parietal cortex, and the cerebellum. This basic feedback control circuit is modulated by estimates of reward and cost via the basal ganglia as well as by arousal states coordinated by the insula, dorsal anterior cingulate cortex, amygdala, and locus coeruleus. One major approach within the broader field of control theory, known as proportion-integral-derivative (PID) control, has shown promise as a model of human behavior which enables precise and reliable estimates of underlying control parameters at the individual level. These control parameters correlate with self-reported fear and with both structural and functional variation in affect-related brain regions. This suggests that dysfunctional engagement of stress and arousal systems may suboptimally modulate parameters of domain-general goal-directed control algorithms, impairing performance in complex tasks involving movement, cognition, and affect. Future directions include clarifying the causal role of control deficits in stress- and anxiety-related disorders and developing clinically useful tools based on insights from control theory.

Temporal stability of Bayesian belief updating in perceptual decision-making

Bayesian inference suggests that perception is inferred from a weighted integration of prior contextual beliefs with current sensory evidence (likelihood) about the world around us. The perceived precision or uncertainty associated with prior and likelihood information is used to guide perceptual decision-making, such that more weight is placed on the source of information with greater precision. This provides a framework for understanding a spectrum of clinical transdiagnostic symptoms associated with aberrant perception, as well as individual differences in the general population. While behavioral paradigms are commonly used to characterize individual differences in perception as a stable characteristic, measurement reliability in these behavioral tasks is rarely assessed. To remedy this gap, we empirically evaluate the reliability of a perceptual decision-making task that quantifies individual differences in Bayesian belief updating in terms of the relative precision weighting afforded to prior and likelihood information (i.e., sensory weight). We analyzed data from participants (n = 37) who performed this task twice. We found that the precision afforded to prior and likelihood information showed high internal consistency and good test-retest reliability (ICC = 0.73, 95% CI [0.53, 0.85]) when averaged across participants, as well as at the individual level using hierarchical modeling. Our results provide support for the assumption that Bayesian belief updating operates as a stable characteristic in perceptual decision-making. We discuss the utility and applicability of reliable perceptual decision-making paradigms as a measure of individual differences in the general population, as well as a diagnostic tool in psychiatric research.

Listening to the Data: Computational Approaches to Addiction and Learning

Computational approaches hold great promise for identifying novel treatment targets and creating translational therapeutics for substance use disorders. From circuitries underlying decision-making to computationally derived neural markers of drug-cue reactivity, this review is a summary of the approaches to data presented at our 2023 Society for Neuroscience Mini-Symposium. Here, we highlight data- and hypothesis-driven computational approaches that recently afforded advancements in addiction and learning neuroscience. First, we discuss the value of hypothesis-driven algorithmic modeling approaches, which integrate behavioral, neural, and cognitive outputs to refine hypothesis testing. Then, we review the advantages of data-driven dimensionality reduction and machine learning methods for uncovering novel predictor variables and elucidating relationships in high-dimensional data. Overall, this review highlights recent breakthroughs in cognitive mapping, model-based analysis of behavior/risky decision-making, patterns of drug taking, relapse, and neuromarker discovery, and showcases the benefits of novel modeling techniques, across both preclinical and clinical data.

Neighborhood air pollution is negatively associated with neurocognitive maturation in early adolescence

The ability to maintain focus and process task-relevant information continues developing during adolescence, but the specific physical environmental factors that influence this development remain poorly characterized. One candidate factor is air pollution. Evidence suggests that small particulate matter and NO2 concentrations in the air may negatively impact cognitive development in childhood. We assessed the relationship between neighborhood air pollution and the changes in performance on the n-back task, a test of attention and working memory, in the Adolescent Brain Cognitive Development (ABCD) Study's baseline (ages 9-10) and two-year-follow-up releases (Y2, ages 11-12; n = 5,256). In the behavioral domain, multiple linear regression showed that developmental change in n-back task performance was negatively associated with neighborhood air pollution (β = -.044, t = -3.11, p = .002), adjusted for covariates capturing baseline cognitive performance of the child, their parental income and education, family conflicts, and their neighborhood's population density, crime rate, perceived safety, and Area Deprivation Index (ADI). The strength of the adjusted association for air pollution was similar to parental income, family conflict, and neighborhood ADI. In the neuroimaging domain, we evaluated a previously published youth cognitive composite Connectome-based Predictive Model (ccCPM), and again found that decreased developmental change in the strength of the ccCPM from pre- to early adolescence was associated with neighborhood air pollution (β = -.110, t = -2.69, p = .007), adjusted for the covariates mentioned above and head motion. Finally, we found that the developmental change in ccCPM strength was predictive of the developmental change in n-back performance (r = .157, p < .001), and there was an indirect-only mediation where the effect of air pollution on change in n-back performance was mediated by the change in the ccCPM strength (βindirect effect = -.013, p = .029). In conclusion, neighborhood air pollution is associated with lags in the maturation of youth cognitive performance and decreased strengthening of the brain networks supporting cognitive abilities over time.

The role of pharmacogenomics in precision psychiatry

The field of psychiatry is facing an important paradigm shift in the provision of clinical care and mental health service organization toward personalization and integration of multimodal data science. This approach, termed precision psychiatry, aims at identifying subgroups of patients more prone to the development of a certain phenotype, such as symptoms or severe mental disorders (risk detection), and/or to guide treatment selection. Pharmacogenomics and computational psychiatry are two fundamental tools of precision psychiatry, which have seen increasing levels of integration in clinical settings. Here we present a brief overview of these two applications of precision psychiatry in clinical settings.

Suicide prevention and ketamine: insights from computational modeling

Suicide is a pressing public health issue, with over 700,000 individuals dying each year. Ketamine has emerged as a promising treatment for suicidal thoughts and behaviors (STBs), yet the complex mechanisms underlying ketamine's anti-suicidal effect are not fully understood. Computational psychiatry provides a promising framework for exploring the dynamic interactions underlying suicidality and ketamine's therapeutic action, offering insight into potential biomarkers, treatment targets, and the underlying mechanisms of both. This paper provides an overview of current computational theories of suicidality and ketamine's mechanism of action, and discusses various computational modeling approaches that attempt to explain ketamine's anti-suicidal effect. More specifically, the therapeutic potential of ketamine is explored in the context of the mismatch negativity and the predictive coding framework, by considering neurocircuits involved in learning and decision-making, and investigating altered connectivity strengths and receptor densities targeted by ketamine. Theory-driven computational models offer a promising approach to integrate existing knowledge of suicidality and ketamine, and for the extraction of model-derived mechanistic parameters that can be used to identify patient subgroups and personalized treatment approaches. Future computational studies on ketamine's mechanism of action should optimize task design and modeling approaches to ensure parameter reliability, and external factors such as set and setting, as well as psychedelic-assisted therapy should be evaluated for their additional therapeutic value.