Aberrant computational mechanisms of social learning and decision-making in schizophrenia and borderline personality disorder

Reinforcement learning impairment in individuals with euthymic bipolar I disorder with a history of psychosis

Reinforcement-learning (RL) impairment is an important determinant of functional outcome in bipolar-disorder (BD). This study examined RL in 38 euthymic bipolar-I-disorder (BD-I) individuals aged 16-40 years who were treated within three years from first-episode mania with psychosis and 40 demographically-matched healthy-controls using a computerized RL-paradigm, which investigated rapid and gradual learning, and reward-driven and punishment-driven learning. Symptom severity and cognitive functions were assessed. Our results showed that BD-I individuals displayed lower lose-shift scores than controls (p = 0.03). There were no group differences in other rapid RL measures. Regarding overall RL, a repeated-measures ANOVA revealed main effect of group (F1,76 = 6.5, p = 0.03; controls performed better than patients), block (F2.87,218.45 = 43.7, p < 0.001; performance improving over time) and probability (F1,76 = 15.6, p < 0.001; better performance in 90% than in 80% condition). Post-hoc analysis revealed that controls performed better than BD-I individuals on loss-avoidance stimuli (p = 0.02). Better performance of controls relative to BD-I individuals on gain stimuli approached statistical significance (p = 0.06). No correlations of RL measures with symptoms, cognition or antipsychotic dose were observed. In conclusion, this study is among the few to examine RL impairment in euthymic BD-I with history of psychosis at a relatively early illness stage, and indicates that BD-I individuals displayed punishment-driven learning (i.e., negative RL) deficits compared with controls. Diminished punishment-sensitivity may indicate vulnerability to maladaptive behaviors, particularly in response to negative events or stress, and poorer functional impairment. Further research is required to clarify longitudinal trajectory of punishment-insensitivity and its relationship with psychosis and functional outcomes in the early-stage of BD.

Understanding the neurobiology and computational mechanisms of social conformity: implications for psychiatric disorders

Social conformity and psychiatric disorders share overlapping brain regions and neural pathways, arousing our interest in uncovering their potentially shared underlying neural and computational mechanisms. Critically, the dynamics of group behavior may either mitigate or exacerbate mental health conditions, highlighting the need to bridge social neuroscience and psychiatry. Our work examines how aberrant neurobiological circuits and computations influence social conformity. We propose a hierarchical computational framework, based on dynamical systems and active inference, to facilitate the interpretation of the multi-layered interplay among processes that drive social conformity. We underscore the significant implications of this hierarchical computational framework for guiding future research on psychiatry, particularly with respect to the clinical translation of interventions such as targeted pharmacotherapy and neurostimulation techniques. The interdisciplinary efforts hold the potential to propel the fields of social and clinical neuroscience forward, fostering the emergence of more efficacious and individualized therapeutic approaches tailored to psychiatric disorders characterized by aberrant social behaviors.

I fear you're getting too close: neural correlates of personal space violation in paranoia

Increased personal space (PS) is a clinically relevant marker for paranoia. Neuroimaging evidence suggested limbic and prefrontal circuit alterations related to threat processing and emotion regulation (i.e., amygdala, fronto-parietal cortex). We hypothesize that patients with paranoia will respond with altered activation in PS-relevant brain areas (i.e., limbic regions, fronto-parietal cortex) toward personal space intrusion. We included 79 participants with various degrees of paranoia severity; 49 patients diagnosed with schizophrenia and 30 controls. In this fMRI study, participants passively viewed pictures of facial expressions in approaching, static, or retracting motions. Violation of PS was modelled with the approaching faces condition. We used firstly a cut off to separate patients in high and low paranoia, and secondly the continuous variations of paranoia severity to understand the full picture. While participants were passively watching faces approaching them in contrast to static faces, group comparison revealed that patients with high paranoia showed hypoactivity mainly in the OFC when compared to patients with low paranoia, and hypoactivity in dlPFC and dPCC when compared to controls. Further, paranoia severity was positively associated with activation of the right hippocampus. Altered neural activity in the OFC, dlPFC, and hippocampus may well reflect the neural responses to the paranoid experience of threat and provide evidence for the hypothesized association between limbic dysfunction and paranoid threat. Modelling of paranoia severity captures variance in neural response to approaching threat, which may be previously undetected due to heterogeneity when examined at the group level.

Precision-dependent modulation of social attention

Social attention, guided by cues like gaze direction, is crucial for effective social interactions. However, how dynamic environmental context modulates this process remains unclear. Integrating a hierarchical Bayesian model with fMRI, this study investigated how individuals adjusted attention based on the predictions about cue validity (CV). Thirty-three participants performed a modified Posner location-cueing task with varying CV. Behaviorally, individuals' allocation of social attention was finely tuned to the precision (inverse variance) of CV predictions, with the predictions updated by precision-weighted prediction errors (PEs) about the occurrence of target locations. Neuroimaging results revealed that the interaction between allocation of social attention and CV influenced activity in regions involved in spatial attention and/or social perception. Precision-weighted PEs about target locations specifically modulated activity in the temporoparietal junction (TPJ), superior temporal sulcus (STS), and primary visual cortex (V1), underscoring their roles in refining attentional predictions. Dynamic causal modeling (DCM) further demonstrated that enhanced absolute precision-weighted PEs about target locations strengthened the effective connectivity from V1 and STS to TPJ, emphasizing their roles in conveying residual error signals upwards to high-level critical attention areas. These findings emphasized the pivotal role of precision in attentional modulation, enhancing our understanding of context-dependent social attention.

Psychotic-Like Reasoning Styles in Patients With Borderline Personality Disorder? An Experimental Investigation of the Jumping to Conclusions Bias

INTRODUCTION

Patients with borderline personality disorder (BPD) commonly display psychotic symptoms such as hallucinations or delusional/paranoid ideas. We used the fish task to investigate cognitive biases (jumping to conclusions and overcorrection) implicated in the aetiology of psychotic symptoms in patients with BPD.

METHODS

Participants received consecutive pieces of information to determine which of two lakes a fisherman was catching fish from. Outcome measures were draws to decision and frequency of premature decisions after just one and after not more than two fish (jumping to conclusions), probability estimate at the time of the decision (decision threshold) and adjustment of the probability estimate after receiving disconfirmatory information (overcorrection). With data aggregated from multiple studies, a total of 170 patients with BPD and 72 healthy controls (parallelized by age, gender and education) participated.

RESULTS

The two groups showed similar draws to decision and frequencies of premature decisions. The decision threshold was also comparable across the groups. However, the patients with BPD showed overcorrection.

CONCLUSIONS

The experimental study found no evidence for a jumping to conclusions bias or a lower decision threshold in patients with BPD. The stronger adjustment of probability estimates (overcorrection) in patients with BPD is compatible with the unstable affect, self-image and interpersonal relationships observed in patients with BPD.

Counteracting uncertainty: exploring the impact of anxiety on updating predictions about environmental states

Anxious emotional states disrupt decision-making and control of dexterous motor actions. Computational work has shown that anxiety-induced uncertainty alters the rate at which we learn about the environment, but the subsequent impact on the predictive beliefs that drive action control remains to be understood. In the present work we tested whether anxiety alters predictive (oculo)motor control mechanisms. Thirty participants completed an experimental task that consisted of manual interception of a projectile performed in virtual reality. Participants were subjected to conditions designed to induce states of high or low anxiety using performance incentives and social-evaluative pressure. We measured subsequent effects on physiological arousal, self-reported state anxiety, and eye movements. Under high pressure conditions we observed visual sampling of the task environment characterised by higher variability and entropy of position prior to release of the projectile, consistent with an active attempt to reduce uncertainty. Computational modelling of predictive beliefs, using gaze data as inputs to a partially observable Markov decision process model, indicated that trial-to-trial updating of predictive beliefs was reduced during anxiety, suggesting that updates to priors were constrained. Additionally, state anxiety was related to a less deterministic mapping of beliefs to actions. These results support the idea that organisms may attempt to counter anxiety-related uncertainty by moving towards more familiar and certain sensorimotor patterns.

Dissociating social reward learning and behavior in alcohol use disorder

BACKGROUND

Alcohol use disorder (AUD) is associated with deficits in social cognition and behavior, but why these deficits are acquired is unknown. We hypothesized that a reduced association between actions and outcomes for others, i.e., social reward learning, would explain prevalent social deficiencies in AUD.

METHODS

We conducted one laboratory study (n = 234) and one confirmatory online study (n = 258), comparing young adults with AUD to age-, gender-, and education-matched healthy controls on a standardized reward learning task. In the task, participants learned to maximize reward for another person and for oneself. To elucidate the potential relation between reward learning and social behavior in AUD, we administered two measures: a dictator game task and a self-report measure. Finally, we applied reinforcement learning models to examine the computational properties of learning.

RESULTS

Social and individual learning, expressed in choice behavior, were comparable in individuals with AUD and healthy controls. Individual differences in learning were not associated with reduced social behavior in AUD. Computational modeling suggested that the learning mechanisms are comparable in AUD and healthy controls and indifferent to whether learning maximizes reward for another person or oneself.

CONCLUSIONS

Individuals with AUD demonstrated preserved reward learning abilities that do not vary with social behavior. Together, these results indicate that reward processes may not be relevant for understanding compromised social behavior in AUD.

Computational Phenotyping of Aberrant Belief Updating in Individuals With Schizotypal Traits and Schizophrenia

BACKGROUND

Psychotic experiences are thought to emerge from various interrelated patterns of disrupted belief updating, such as overestimating the reliability of sensory information and misjudging task volatility, yet these substrates have never been jointly addressed under one computational framework, and it is not clear to what degree they reflect trait-like computational patterns.

METHODS

We introduce a novel hierarchical Bayesian model that describes how individuals simultaneously update their beliefs about the task volatility and noise in observation. We applied this model to data from a modified predictive inference task in a test-retest study with healthy volunteers (N = 45, 4 sessions) and examined the relationship between model parameters and schizotypal traits in a larger online sample (N = 437) and in a cohort of patients with schizophrenia (N = 100).

RESULTS

The interclass correlations were moderate to high for model parameters and excellent for averaged belief trajectories and precision-weighted learning rates estimated through hierarchical Bayesian inference. We found that uncertainty about the task volatility was related to schizotypal traits and to positive symptoms in patients, when learning to gain rewards. In contrast, negative symptoms in patients were associated with more rigid beliefs about observational noise, when learning to avoid losses.

CONCLUSIONS

These findings suggest that individuals with schizotypal traits across the psychosis continuum are less likely to learn or use higher-order statistical regularities of the environment and showcase the potential of clinically relevant computational phenotypes for differentiating symptom groups in a transdiagnostic manner.

A computational signature of self-other mergence in Borderline Personality Disorder

A tendency to merge mental representations of self and other is thought to underpin the intense and unstable relationships that feature in Borderline Personality Disorder (BPD). However, clinical theories of BPD do not specify, in computational terms, how the perspectives of self and other might become confused. To address this question, we used a probabilistic false belief task (p-FBT) to examine how individuals with BPD (N = 38) and matched controls from the general population (N = 74) selectively assigned beliefs to self or other. The p-FBT requires participants to track a gradually changing quantity, whilst also predicting another person's belief about that quantity. We found that BPD participants showed less selectivity in belief assignment compared with controls (Cohen's d = 0.64). Behaviourally, participants with BPD tended to predict that others' beliefs resembled their own. Modelling analysis revealed that BPD participants were prone to generalise their own learning signals to others. Furthermore, this generalising tendency correlated with BPD symptomatology across participants, even when controlling for demographic factors and affective psychopathology. Our results support a computational account of self-other mergence, based on a generalisation of learning across agents. Self-other generalisation in learning purports to explain key clinical features of BPD, and suggests a potential transdiagnostic marker of mentalising capability.

Test-retest reliability of behavioral and computational measures of advice taking under volatility

The development of computational models for studying mental disorders is on the rise. However, their psychometric properties remain understudied, posing a risk of undermining their use in empirical research and clinical translation. Here we investigated test-retest reliability (with a 2-week interval) of a computational assay probing advice-taking under volatility with a Hierarchical Gaussian Filter (HGF) model. In a sample of 39 healthy participants, we found the computational measures to have largely poor reliability (intra-class correlation coefficient or ICC < 0.5), on par with the behavioral measures of task performance. Further analysis revealed that reliability was substantially impacted by intrinsic measurement noise (indicated by parameter recovery analysis) and to a smaller extent by practice effects. However, a large portion of within-subject variance remained unexplained and may be attributable to state-like fluctuations. Despite the poor test-retest reliability, we found the assay to have face validity at the group level. Overall, our work highlights that the different sources of variance affecting test-retest reliability need to be studied in greater detail. A better understanding of these sources would facilitate the design of more psychometrically sound assays, which would improve the quality of future research and increase the probability of clinical translation.

Attachment and borderline personality disorder as the dance unfolds: A quantitative analysis of a novel paradigm

Current research on personality disorders strives to identify key behavioural and cognitive facets of patient functioning, to unravel the underlying root causes and maintenance mechanisms. This process often involves the application of social paradigms - however, these often only include momentary affective depictions rather than unfolding interactions. This constitutes a limitation in our capacity to probe core symptoms, and leaves potential findings uncovered which could help those who are in close relationships with affected individuals. Here, we deployed a novel task in which subjects interact with four unknown virtual partners in a turn-taking paradigm akin to a dance, and report on their experience with each. The virtual partners embody four combinations of low/high expressivity of positive/negative mood. Higher scores on our symptomatic measures of attachment anxiety, avoidance, and borderline personality disorder (BPD) were all linked to a general negative appraisal of all the interpersonal experiences. Moreover, the negative appraisal of the partner who displayed a high negative/low positive mood was tied with attachment anxiety and BPD symptoms. The extent to which subjects felt responsible for causing partners' distress was most strongly linked to attachment anxiety. Finally, we provide a fully-fledged exploration of move-by-move action latencies and click distances from partners. This analysis underscored slower movement initiation from anxiously attached individuals throughout all virtual interactions. In summary, we describe a novel paradigm for second-person neuroscience, which allowed both the replication of established results and the capture of new behavioural signatures associated with attachment anxiety, and discuss its limitations.

A social inference model of idealization and devaluation

People often form polarized beliefs, imbuing objects (e.g., themselves or others) with unambiguously positive or negative qualities. In clinical settings, this is referred to as dichotomous thinking or "splitting" and is a feature of several psychiatric disorders. Here, we introduce a Bayesian model of splitting that parameterizes a tendency to rigidly categorize objects as either entirely "Bad" or "Good," rather than to flexibly learn dispositions along a continuous scale. Distinct from the previous descriptive theories, the model makes quantitative predictions about how dichotomous beliefs emerge and are updated in light of new information. Specifically, the model addresses how splitting is context-dependent, yet exhibits stability across time. A key model feature is that phases of devaluation and/or idealization are consolidated by rationally attributing counter-evidence to external factors. For example, when another person is idealized, their less-than-perfect behavior is attributed to unfavorable external circumstances. However, sufficient counter-evidence can trigger switches of polarity, producing bistable dynamics. We show that the model can be fitted to empirical data, to measure individual susceptibility to relational instability. For example, we find that a latent categorical belief that others are "Good" accounts for less changeable, and more certain, character impressions of benevolent as opposed to malevolent others among healthy participants. By comparison, character impressions made by participants with borderline personality disorder reveal significantly higher and more symmetric splitting. The generative framework proposed invites applications for modeling oscillatory relational and affective dynamics in psychotherapeutic contexts. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Bayesian Decision-Making Under Uncertainty in Borderline Personality Disorder

Bayesian decision theory suggests that optimal decision-making should use and weigh prior beliefs with current information, according to their relative uncertainties. However, some characteristics of borderline personality disorder (BPD) patients, such as fast, drastic changes in the overall perception of themselves and others, suggest they may be underrelying on priors. Here, we investigated if BPD patients have a general deficit in relying on or combining prior with current information. We analyzed this by having BPD patients (n = 23) and healthy controls (n = 18) perform a coin-catching sensorimotor task with varying levels of prior and current information uncertainty. Our results indicate that BPD patients learned and used prior information and combined it with current information in a qualitatively Bayesian-like way. Our results show that, at least in a lower-level, nonsocial sensorimotor task, BPD patients can appropriately use both prior and current information, illustrating that potential deficits using priors may not be widespread or domain-general.

Modulation of Trust in Borderline Personality Disorder by Script-Based Imaginal Exposure to Betrayal

Interpersonal and trust-related difficulties are central features of borderline personality disorder (BPD). In this study, we applied script-driven betrayal imagery to evoke mistrustful behavior in a social reinforcement learning task. In 21 BPD and 20 healthy control (HC) participants, we compared this approach to the standard confederate paradigm used in research studies. The script-driven imagery evoked a transient increase in negative affect and also decreased trusting behavior to a similar degree in both groups. Across conditions, we also replicated previously reported between-group differences in negative affect (increased in BPD) and task behavior (more sensitive to social cues in BPD). These results support the validity of script-driven imagery as an alternative social task stimulus. This script-driven imagery approach is appealing for clinical research studies on reinforcement learning because it eliminates deception, scales easily, and evokes disorder-specific states of social difficulty.

The interpersonal computational psychiatry of social coordination in schizophrenia

Impairments in social coordination form a core dimension of various psychiatric disorders, including schizophrenia. Advances in interpersonal and computational psychiatry support a major change in studying social coordination in schizophrenia. Although these developments provided novel perspectives to study how interpersonal activities shape coordination and to examine computational mechanisms, direct attempts to integrate the two methodologies have been sparse. Here, we propose an interpersonal computational framework that (1) leverages the active inference framework to model aberrant social coordination processes in schizophrenia and (2) incorporates dynamical system models to dissect intrapersonal and interpersonal synchronisation to inform a statistical model based on active inference. We discuss how this interpersonal computational psychiatry framework can elucidate the aberrant processes leading to psychopathology, with schizophrenia as an example, and highlight how it might aid clinical intervention and practice. Finally, we discuss challenges and opportunities for using the framework in studying social coordination impairments.

Testing predictive coding theories of autism spectrum disorder using models of active inference

Several competing neuro-computational theories of autism have emerged from predictive coding models of the brain. To disentangle their subtly different predictions about the nature of atypicalities in autistic perception, we performed computational modelling of two sensorimotor tasks: the predictive use of manual gripping forces during object lifting and anticipatory eye movements during a naturalistic interception task. In contrast to some accounts, we found no evidence of chronic atypicalities in the use of priors or weighting of sensory information during object lifting. Differences in prior beliefs, rates of belief updating, and the precision weighting of prediction errors were, however, observed for anticipatory eye movements. Most notably, we observed autism-related difficulties in flexibly adapting learning rates in response to environmental change (i.e., volatility). These findings suggest that atypical encoding of precision and context-sensitive adjustments provide a better explanation of autistic perception than generic attenuation of priors or persistently high precision prediction errors. Our results did not, however, support previous suggestions that autistic people perceive their environment to be persistently volatile.

Control dilemma: Evidence of the stability-flexibility trade-off

Cognitive control can be applied flexibly when task goals or environments change (i.e., cognitive flexibility), or stably to pursue a goal in the face of distraction (i.e., cognitive stability). Whether these seemingly contradictory characteristics have an inverse relationship has been controversial, as some studies have suggested a trade-off mechanism between cognitive flexibility and cognitive stability, while others have not found such reciprocal associations. This study investigated the possible antagonistic correlation between cognitive flexibility and stability using a novel version of the flexibility-stability paradigm and the classic cued task switching paradigm. In Experiment 1, we showed that cognitive flexibility was inversely correlated with cognitive stability, as increased distractor proportions were associated with decreased cognitive flexibility and greater cognitive stability. Moreover, cognitive flexibility and stability were regulated by a single control system instead of two independent control mechanisms, as the model selection results indicated that the reciprocally regulated model with one integration parameter outperformed all other models, and the model parameter was inversely linked to cognitive flexibility and stability. We found similar results using the classic cued task switching paradigm in Experiment 2. Therefore, a trade-off between cognitive flexibility and stability was observed from the paradigms used in this study.

Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty

People radically differ in how they cope with uncertainty. Clinical researchers describe a dispositional characteristic known as "intolerance of uncertainty", a tendency to find uncertainty aversive, reported to be elevated across psychiatric and neurodevelopmental conditions. Concurrently, recent research in computational psychiatry has leveraged theoretical work to characterise individual differences in uncertainty processing. Under this framework, differences in how people estimate different forms of uncertainty can contribute to mental health difficulties. In this review, we briefly outline the concept of intolerance of uncertainty within its clinical context, and we argue that the mechanisms underlying this construct may be further elucidated through modelling how individuals make inferences about uncertainty. We will review the evidence linking psychopathology to different computationally specified forms of uncertainty and consider how these findings might suggest distinct mechanistic routes towards intolerance of uncertainty. We also discuss the implications of this computational approach for behavioural and pharmacological interventions, as well as the importance of different cognitive domains and subjective experiences in studying uncertainty processing.

Invasive Computational Psychiatry

Computational psychiatry, a relatively new yet prolific field that aims to understand psychiatric disorders with formal theories about the brain, has seen tremendous growth in the past decade. Despite initial excitement, actual progress made by computational psychiatry seems stagnant. Meanwhile, understanding of the human brain has benefited tremendously from recent progress in intracranial neuroscience. Specifically, invasive techniques such as stereotactic electroencephalography, electrocorticography, and deep brain stimulation have provided a unique opportunity to precisely measure and causally modulate neurophysiological activity in the living human brain. In this review, we summarize progress and drawbacks in both computational psychiatry and invasive electrophysiology and propose that their combination presents a highly promising new direction-invasive computational psychiatry. The value of this approach is at least twofold. First, it advances our mechanistic understanding of the neural computations of mental states by providing a spatiotemporally precise depiction of neural activity that is traditionally unattainable using noninvasive techniques with human subjects. Second, it offers a direct and immediate way to modulate brain states through stimulation of algorithmically defined neural regions and circuits (i.e., algorithmic targeting), thus providing both causal and therapeutic insights. We then present depression as a use case where the combination of computational and invasive approaches has already shown initial success. We conclude by outlining future directions as a road map for this exciting new field as well as presenting cautions about issues such as ethical concerns and generalizability of findings.

Belief updating in psychosis, depression and anxiety disorders: A systematic review across computational modelling approaches

Alterations in belief updating are proposed to underpin symptoms of psychiatric illness, including psychosis, depression, and anxiety. Key parameters underlying belief updating can be captured using computational modelling techniques, aiding the identification of unique and shared deficits, and improving diagnosis and treatment. We systematically reviewed research that applied computational modelling to probabilistic tasks measuring belief updating in stable and volatile (changing) environments, across clinical and subclinical psychosis (n = 17), anxiety (n = 9), depression (n = 9) and transdiagnostic samples (n = 9). Depression disorders related to abnormal belief updating in response to the valence of rewards, evidenced in both stable and volatile environments. Whereas psychosis and anxiety disorders were associated with difficulties adapting to changing contingencies specifically, indicating an inflexibility and/or insensitivity to environmental volatility. Higher-order learning models revealed additional difficulties in the estimation of overall environmental volatility across psychosis disorders, showing increased updating to irrelevant information. These findings stress the importance of investigating belief updating in transdiagnostic samples, using homogeneous experimental and computational modelling approaches.

Brain connectivity modulation by Bayesian surprise in relation to control demand drives cognitive flexibility via control engagement

Human control is characterized by its flexibility and adaptability in response to the conditional probability in the environment. Previous studies have revealed that efficient conflict control could be attained by predicting and adapting to the changing control demand. However, it is unclear whether cognitive flexibility could also be gained by predicting and adapting to the changing control demand. The present study aimed to explore this issue by combining the model-based analyses of behavioral and neuroimaging data with a probabilistic cued task switching paradigm. We demonstrated that the Bayesian surprise (i.e. unsigned precision-weighted prediction error [PE]) negatively modulated the connections among stimulus processing brain regions and control regions/networks. The effect of Bayesian surprise modulation on these connections guided control engagement as reflected by the control PE effect on behavior, which in turn facilitated cognitive flexibility. These results bridge a gap in the literature by illustrating the neural and behavioral effect of control demand prediction (or PE) on cognitive flexibility and offer novel insights into the source of switch cost and the mechanism of cognitive flexibility.

Interpersonal attunement in social interactions: from collective psychophysiology to inter-personalized psychiatry and beyond

In this article, we analyse social interactions, drawing on diverse points of views, ranging from dialectics, second-person neuroscience and enactivism to dynamical systems, active inference and machine learning. To this end, we define interpersonal attunement as a set of multi-scale processes of building up and materializing social expectations-put simply, anticipating and interacting with others and ourselves. While cultivating and negotiating common ground, via communication and culture-building activities, are indispensable for the survival of the individual, the relevant multi-scale mechanisms have been largely considered in isolation. Here, collective psychophysiology, we argue, can lend itself to the fine-tuned analysis of social interactions, without neglecting the individual. On the other hand, an interpersonal mismatch of expectations can lead to a breakdown of communication and social isolation known to negatively affect mental health. In this regard, we review psychopathology in terms of interpersonal misattunement, conceptualizing psychiatric disorders as disorders of social interaction, to describe how individual mental health is inextricably linked to social interaction. By doing so, we foresee avenues for an inter-personalized psychiatry, which moves from a static spectrum of disorders to a dynamic relational space, focusing on how the multi-faceted processes of social interaction can help to promote mental health. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

Computational models of subjective feelings in psychiatry

Research in computational psychiatry is dominated by models of behavior. Subjective experience during behavioral tasks is not well understood, even though it should be relevant to understanding the symptoms of psychiatric disorders. Here, we bridge this gap and review recent progress in computational models for subjective feelings. For example, happiness reflects not how well people are doing, but whether they are doing better than expected. This dependence on recent reward prediction errors is intact in major depression, although depressive symptoms lower happiness during tasks. Uncertainty predicts subjective feelings of stress in volatile environments. Social prediction errors influence feelings of self-worth more in individuals with low self-esteem despite a reduced willingness to change beliefs due to social feedback. Measuring affective state during behavioral tasks provides a tool for understanding psychiatric symptoms that can be dissociable from behavior. When smartphone tasks are collected longitudinally, subjective feelings provide a potential means to bridge the gap between lab-based behavioral tasks and real-life behavior, emotion, and psychiatric symptoms.

Can you trust this source? Advice taking in borderline personality disorder

Research suggests that patients with borderline personality disorder (BPD) share a range of cognitive biases with patients with psychosis. As the disorder often manifests in dysfunctional social interactions, we assumed associated reasoning styles would be exaggerated in a social setting. For the present study, we applied the Judge-Advisor System by asking participants to provide initial estimates of a person's age and presumed hostility based on a portrait photo. Afterwards, we presented additional cues/advice in the form of responses by anonymous previous respondents. Participants could revise their estimate, seek additional advice, or make a decision. Contrary to our preregistered hypothesis, patients with BPD (n = 38) performed similarly to healthy controls (n = 30). Patients sought the same number of pieces of advice, were equally confident, and used advice in similar ways to revise their estimates. Thus, patients with BPD did trust advice. However, patients gave higher hostility ratings to the portrayed persons. In conclusion, patients with BPD showed no cognitive biases in seeking, evaluating, and integrating socially provided information. While the study implies emotional rather than cognitive biases in the disorder, cognitive biases may still prove to be useful treatment targets in order to encourage delaying and reflecting on extreme emotional responses in social interactions.

Task-evoked pupillary responses track precision-weighted prediction errors and learning rate during interceptive visuomotor actions

In this study, we examined the relationship between physiological encoding of surprise and the learning of anticipatory eye movements. Active inference portrays perception and action as interconnected inference processes, driven by the imperative to minimise the surprise of sensory observations. To examine this characterisation of oculomotor learning during a hand-eye coordination task, we tested whether anticipatory eye movements were updated in accordance with Bayesian principles and whether trial-by-trial learning rates tracked pupil dilation as a marker of 'surprise'. Forty-four participants completed an interception task in immersive virtual reality that required them to hit bouncing balls that had either expected or unexpected bounce profiles. We recorded anticipatory eye movements known to index participants' beliefs about likely ball bounce trajectories. By fitting a hierarchical Bayesian inference model to the trial-wise trajectories of these predictive eye movements, we were able to estimate each individual's expectations about bounce trajectories, rates of belief updating, and precision-weighted prediction errors. We found that the task-evoked pupil response tracked prediction errors and learning rates but not beliefs about ball bounciness or environmental volatility. These findings are partially consistent with active inference accounts and shed light on how encoding of surprise may shape the control of action.

The (un)learning of social functions and its significance for mental health

Social interactions are dynamic, context-dependent, and reciprocal events that influence prospective strategies and require constant practice and adaptation. This complexity of social interactions creates several research challenges. We propose a new framework encouraging future research to investigate not only individual differences in capacities relevant for social functioning and their underlying mechanisms, but also the flexibility to adapt or update one's social abilities. We suggest three key capacities relevant for social functioning: (1) social perception, (2) sharing emotions or empathizing, and (3) mentalizing. We elaborate on how adaptations in these capacities may be investigated on behavioral and neural levels. Research on these flexible adaptations of one's social behavior is needed to specify how humans actually "learn to be social". Learning to adapt implies plasticity of the relevant brain networks involved in the underlying social processes, indicating that social abilities are malleable for different contexts. To quantify such measures, researchers need to find ways to investigate learning through dynamic changes in adaptable social paradigms and examine several factors influencing social functioning within the three aformentioned social key capacities. This framework furthers insight concerning individual differences, provides a holistic approach to social functioning, and may improve interventions for ameliorating social abilities in patients.

Threat induction biases processing of emotional expressions

Threats can derive from our physical or social surroundings and bias the way we perceive and interpret a given situation. They can be signaled by peers through facial expressions, as expressed anger or fear can represent the source of perceived threat. The current study seeks to investigate enhanced attentional state and defensive reflexes associated with contextual threat induced through aversive sounds presented in an emotion recognition paradigm. In a sample of 120 healthy participants, response and gaze behavior revealed differences in perceiving emotional facial expressions between threat and safety conditions: Responses were slower under threat and less accurate. Happy and neutral facial expressions were classified correctly more often in a safety context and misclassified more often as fearful under threat. This unidirectional misclassification suggests that threat applies a negative filter to the perception of neutral and positive information. Eye movements were initiated later under threat, but fixation changes were more frequent and dwell times shorter compared to a safety context. These findings demonstrate that such experimental paradigms are capable of providing insight into how context alters emotion processing at cognitive, physiological, and behavioral levels. Such alterations may derive from evolutionary adaptations necessary for biasing cognitive processing to survive disadvantageous situations. This perspective sets up new testable hypotheses regarding how such levels of explanation may be dysfunctional in patient populations.

Motivation from Agency and Reward in Typical Development and Autism: Narrative Review of Behavioral and Neural Evidence

Our ability to perform voluntary actions and make choices is shaped by the motivation from having control over the resulting effects (agency) and positive outcomes (reward). We offer an overview of distinct and common behavioral and neural signatures of agency and reward. We discuss their typical and atypical developmental trajectories, focusing on autism spectrum disorder (ASD), which is characterized by neurodiverse processes underlying action selection. We propose that reduced sensitivity to agency and reward in ASD may be related to atypical multisensory processes and motor planning, with potential for understanding restricted and repetitive behaviors. We emphasize the limitations of the existing literature, and prospects for future research. Understanding the neurocognitive processes that shape the way people with ASD select actions and perceive outcomes is essential to support not only learning, but also volition and self-determination.

Reduced neural activity when anticipating social versus nonsocial rewards in schizophrenia: Preliminary evidence from an ERP study

Diminished social motivation is a core feature of schizophrenia that might reflect disturbances in social reward processing. It is not known whether these disturbances reflect anticipatory ("wanting") and/or consummatory ("liking") pleasure deficits. The primary aim of this study was to examine social versus nonsocial reward processing during these temporally distinct substages using event-related potential (ERP) components. Twenty-three schizophrenia participants and 20 healthy participants completed an incentive delay task with social (i.e., smiling expressions) and nonsocial (i.e., money) rewards. We measured two anticipatory ERPs (i.e., "wanting") (target anticipation: Contingent Negative Variation [CNV]; feedback anticipation: Stimulus Preceding Negativity [SPN]) and one consummatory ERP (i.e., "liking") (feedback receipt: P300). As a secondary aim, we examined correlations between the ERPs and interview-rated motivational negative symptoms and social functioning. Schizophrenia participants showed overall less target anticipation (blunted CNV) across all trials (social and nonsocial) than healthy participants. Importantly, schizophrenia participants exhibited less anticipation of social rewards relative to nonsocial rewards (SPN), whereas healthy participants showed similar anticipation for both reward types. Both groups showed similar responses to social and nonsocial reward receipt (P300). Furthermore, social reward anticipation during the incentive delay task was associated with more social approach behaviors in the real-world. Together, these findings provide preliminary evidence for intact social reward "liking" and impaired "wanting" in schizophrenia.

Everything is connected: Inference and attractors in delusions

Delusions are, by popular definition, false beliefs that are held with certainty and resistant to contradictory evidence. They seem at odds with the notion that the brain at least approximates Bayesian inference. This is especially the case in schizophrenia, a disorder thought to relate to decreased - rather than increased - certainty in the brain's model of the world. We use an active inference Markov decision process model (a Bayes-optimal decision-making agent) to perform a simple task involving social and non-social inferences. We show that even moderate changes in some model parameters - decreasing confidence in sensory input and increasing confidence in states implied by its own (especially habitual) actions - can lead to delusions as defined above. Incorporating affect in the model increases delusions, specifically in the social domain. The model also reproduces some classic psychological effects, including choice-induced preference change, and an optimism bias in inferences about oneself. A key observation is that no change in a single parameter is both necessary and sufficient for delusions; rather, delusions arise due to conditional dependencies that create 'basins of attraction' which trap Bayesian beliefs. Simulating the effects of antidopaminergic antipsychotics - by reducing the model's confidence in its actions - demonstrates that the model can escape from these attractors, through this synthetic pharmacotherapy.

Rethinking delusions: A selective review of delusion research through a computational lens

Delusions are rigid beliefs held with high certainty despite contradictory evidence. Notwithstanding decades of research, we still have a limited understanding of the computational and neurobiological alterations giving rise to delusions. In this review, we highlight a selection of recent work in computational psychiatry aimed at developing quantitative models of inference and its alterations, with the goal of providing an explanatory account for the form of delusional beliefs in psychosis. First, we assess and evaluate the experimental paradigms most often used to study inferential alterations in delusions. Based on our review of the literature and theoretical considerations, we contend that classic draws-to-decision paradigms are not well-suited to isolate inferential processes, further arguing that the commonly cited 'jumping-to-conclusion' bias may reflect neither delusion-specific nor inferential alterations. Second, we discuss several enhancements to standard paradigms that show promise in more effectively isolating inferential processes and delusion-related alterations therein. We further draw on our recent work to build an argument for a specific failure mode for delusions consisting of prior overweighting in high-level causal inferences about partially observable hidden states. Finally, we assess plausible neurobiological implementations for this candidate failure mode of delusional beliefs and outline promising future directions in this area.

Impulsivity and Emotional Dysregulation Predict Choice Behavior During a Mixed-Strategy Game in Adolescents With Borderline Personality Disorder

Impulsivity and emotional dysregulation are two core features of borderline personality disorder (BPD), and the neural mechanisms recruited during mixed-strategy interactions overlap with frontolimbic networks that have been implicated in BPD. We investigated strategic choice patterns during the classic two-player game, Matching Pennies, where the most efficient strategy is to choose each option randomly from trial-to-trial to avoid exploitation by one’s opponent. Twenty-seven female adolescents with BPD (mean age: 16 years) and twenty-seven age-matched female controls (mean age: 16 years) participated in an experiment that explored the relationship between strategic choice behavior and impulsivity in both groups and emotional dysregulation in BPD. Relative to controls, BPD participants showed marginally fewer reinforcement learning biases, particularly decreased lose-shift biases, increased variability in reaction times (coefficient of variation; CV), and a greater percentage of anticipatory decisions. A subset of BPD participants with high levels of impulsivity showed higher overall reward rates, and greater modulation of reaction times by outcome, particularly following loss trials, relative to control and BPD participants with lower levels of impulsivity. Additionally, BPD participants with higher levels of emotional dysregulation showed marginally increased reward rate and increased entropy in choice patterns. Together, our preliminary results suggest that impulsivity and emotional dysregulation may contribute to variability in mixed-strategy decision-making in female adolescents with BPD.

Models of Dynamic Belief Updating in Psychosis-A Review Across Different Computational Approaches

To understand the dysfunctional mechanisms underlying maladaptive reasoning of psychosis, computational models of decision making have widely been applied over the past decade. Thereby, a particular focus has been on the degree to which beliefs are updated based on new evidence, expressed by the learning rate in computational models. Higher order beliefs about the stability of the environment can determine the attribution of meaningfulness to events that deviate from existing beliefs by interpreting these either as noise or as true systematic changes (volatility). Both, the inappropriate downplaying of important changes as noise (belief update too low) as well as the overly flexible adaptation to random events (belief update too high) were theoretically and empirically linked to symptoms of psychosis. Whereas models with fixed learning rates fail to adjust learning in reaction to dynamic changes, increasingly complex learning models have been adopted in samples with clinical and subclinical psychosis lately. These ranged from advanced reinforcement learning models, over fully Bayesian belief updating models to approximations of fully Bayesian models with hierarchical learning or change point detection algorithms. It remains difficult to draw comparisons across findings of learning alterations in psychosis modeled by different approaches e.g., the Hierarchical Gaussian Filter and change point detection. Therefore, this review aims to summarize and compare computational definitions and findings of dynamic belief updating without perceptual ambiguity in (sub)clinical psychosis across these different mathematical approaches. There was strong heterogeneity in tasks and samples. Overall, individuals with schizophrenia and delusion-proneness showed lower behavioral performance linked to failed differentiation between uninformative noise and environmental change. This was indicated by increased belief updating and an overestimation of volatility, which was associated with cognitive deficits. Correlational evidence for computational mechanisms and positive symptoms is still sparse and might diverge from the group finding of instable beliefs. Based on the reviewed studies, we highlight some aspects to be considered to advance the field with regard to task design, modeling approach, and inclusion of participants across the psychosis spectrum. Taken together, our review shows that computational psychiatry offers powerful tools to advance our mechanistic insights into the cognitive anatomy of psychotic experiences.

Paranoia, self-deception and overconfidence

Self-deception, paranoia, and overconfidence involve misbeliefs about the self, others, and world. They are often considered mistaken. Here we explore whether they might be adaptive, and further, whether they might be explicable in Bayesian terms. We administered a difficult perceptual judgment task with and without social influence (suggestions from a cooperating or competing partner). Crucially, the social influence was uninformative. We found that participants heeded the suggestions most under the most uncertain conditions and that they did so with high confidence, particularly if they were more paranoid. Model fitting to participant behavior revealed that their prior beliefs changed depending on whether the partner was a collaborator or competitor, however, those beliefs did not differ as a function of paranoia. Instead, paranoia, self-deception, and overconfidence were associated with participants' perceived instability of their own performance. These data are consistent with the idea that self-deception, paranoia, and overconfidence flourish under uncertainty, and have their roots in low self-esteem, rather than excessive social concern. The model suggests that spurious beliefs can have value-self-deception is irrational yet can facilitate optimal behavior. This occurs even at the expense of monetary rewards, perhaps explaining why self-deception and paranoia contribute to costly decisions which can spark financial crashes and devastating wars.

Paranoia and belief updating during the COVID-19 crisis

The COVID-19 pandemic has made the world seem less predictable. Such crises can lead people to feel that others are a threat. Here, we show that the initial phase of the pandemic in 2020 increased individuals' paranoia and made their belief updating more erratic. A proactive lockdown made people's belief updating less capricious. However, state-mandated mask-wearing increased paranoia and induced more erratic behaviour. This was most evident in states where adherence to mask-wearing rules was poor but where rule following is typically more common. Computational analyses of participant behaviour suggested that people with higher paranoia expected the task to be more unstable. People who were more paranoid endorsed conspiracies about mask-wearing and potential vaccines and the QAnon conspiracy theories. These beliefs were associated with erratic task behaviour and changed priors. Taken together, we found that real-world uncertainty increases paranoia and influences laboratory task behaviour.

Human aging alters social inference about others' changing intentions

Decoding others' intentions accurately in order to adapt one's own behavior is pivotal throughout life. In this study, we asked how younger and older adults deal with uncertainty in dynamic social environments. We used an advice-taking paradigm together with Bayesian modeling to characterize effects of aging on learning about others' time-varying intentions. We observed age differences when comparing learning on two levels of social uncertainty: the fidelity of the adviser and the volatility of intentions. Older adults expected the adviser to change his/her intentions more frequently (i.e., a higher volatility of the adviser). They also showed higher confidence (i.e., precision) in their volatility beliefs and were less willing to change their beliefs about volatility over the course of the experiment. This led them to update their predictions about the fidelity of the adviser more quickly. Potentially indicative of stereotype effects, we observed that older advisers were perceived as more volatile, but also more faithful than younger advisers. This offers new insights into adult age differences in response to social uncertainty.