1
|
Schulz L, Streicher Y, Schulz E, Bhui R, Dayan P. Mechanisms of mistrust: A Bayesian account of misinformation learning. PLoS Comput Biol 2025; 21:e1012814. [PMID: 40367148 PMCID: PMC12077715 DOI: 10.1371/journal.pcbi.1012814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/21/2025] [Indexed: 05/16/2025] Open
Abstract
From the intimate realm of personal interactions to the sprawling arena of political discourse, discerning the trustworthy from the dubious is crucial. Here, we present a novel behavioral task and accompanying Bayesian models that allow us to study key aspects of this learning process in a tightly controlled setting. In our task, participants are confronted with several different types of (mis-)information sources, ranging from ones that lie to ones with biased reporting, and have to learn these attributes under varying degrees of feedback. We formalize inference in this setting as a doubly Bayesian learning process where agents simultaneously learn about the ground truth as well as the qualities of an information source reporting on this ground truth. Our model and detailed analyses reveal how participants can generally follow Bayesian learning dynamics, highlighting a basic human ability to learn about diverse information sources. This learning is also reflected in explicit trust reports about the sources. We additionally show how participants approached the inference problem with priors that held sources to be helpful. Finally, when outside feedback was noisier, participants still learned along Bayesian lines but struggled to pick up on biases in information. Our work pins down computationally the generally impressive human ability to learn the trustworthiness of information sources while revealing minor fault lines when it comes to noisier environments and news sources with a slant.
Collapse
Affiliation(s)
- Lion Schulz
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | | | - Eric Schulz
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- Helmholtz Institute for Human-Centered AI, Helmholtz Munich, Munich, Germany
| | - Rahul Bhui
- Sloan School of Management, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
- Institute for Data, Systems, and Society, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- University of Tübingen, Tübingen, Germany
| |
Collapse
|
2
|
García-Arch J, Korn CW, Fuentemilla L. Self-utility distance as a computational approach to understanding self-concept clarity. COMMUNICATIONS PSYCHOLOGY 2025; 3:50. [PMID: 40133620 PMCID: PMC11937342 DOI: 10.1038/s44271-025-00231-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 03/13/2025] [Indexed: 03/27/2025]
Abstract
Self-concept stability and cohesion are crucial for psychological functioning and well-being, yet the mechanisms that underpin this fundamental aspect of human cognition remain underexplored. Integrating insights from cognitive and personality psychology with reinforcement learning, we introduce Self-Utility Distance (SUD)-a metric quantifying the dissimilarities between individuals' self-concept attributes and their expected utility value. In Study 1 (n = 155), participants provided self- and expected utility ratings using a set of predefined adjectives. SUD showed a significant negative relationship with Self-Concept Clarity that persisted after accounting for individuals' Self-Esteem. In Study 2 (n = 323), we found that SUD provides incremental predictive accuracy over Ideal-Self and Ought-Self discrepancies in the prediction of Self-Concept Clarity. In Study 3 (n = 85), we investigated the mechanistic principles underlying Self-Utility Distance. Participants conducted a social learning task where they learned about trait utilities from a reference group. We formalized different computational models to investigate the strategies individuals use to adjust trait utility estimates in response to environmental feedback. Through Hierarchical Bayesian Inference, we found evidence that participants utilized their self-concept to modulate trait utility learning, effectively avoiding the maximization of Self-Utility Distance. Our findings provide insights into self-concept dynamics that might help understand the maintenance of adaptive and maladaptive traits.
Collapse
Affiliation(s)
- Josué García-Arch
- Department of Cognition, Development and Education Psychology, Faculty of Psychology, University of Barcelona, Barcelona, Spain.
- Institute of Neuroscience (UBNeuro), University of Barcelona, Barcelona, Spain.
| | - Christoph W Korn
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany
| | - Lluís Fuentemilla
- Department of Cognition, Development and Education Psychology, Faculty of Psychology, University of Barcelona, Barcelona, Spain
- Institute of Neuroscience (UBNeuro), University of Barcelona, Barcelona, Spain
- Bellvitge Institute for Biomedical Research, 08908 Hospitalet de Llobregat, Barcelona, Spain
| |
Collapse
|
3
|
Bruckner R, Heekeren HR, Nassar MR. Understanding learning through uncertainty and bias. COMMUNICATIONS PSYCHOLOGY 2025; 3:24. [PMID: 39948273 PMCID: PMC11825852 DOI: 10.1038/s44271-025-00203-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/15/2024] [Accepted: 01/28/2025] [Indexed: 02/16/2025]
Abstract
Learning allows humans and other animals to make predictions about the environment that facilitate adaptive behavior. Casting learning as predictive inference can shed light on normative cognitive mechanisms that improve predictions under uncertainty. Drawing on normative learning models, we illustrate how learning should be adjusted to different sources of uncertainty, including perceptual uncertainty, risk, and uncertainty due to environmental changes. Such models explain many hallmarks of human learning in terms of specific statistical considerations that come into play when updating predictions under uncertainty. However, humans also display systematic learning biases that deviate from normative models, as studied in computational psychiatry. Some biases can be explained as normative inference conditioned on inaccurate prior assumptions about the environment, while others reflect approximations to Bayesian inference aimed at reducing cognitive demands. These biases offer insights into cognitive mechanisms underlying learning and how they might go awry in psychiatric illness.
Collapse
Affiliation(s)
- Rasmus Bruckner
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.
- Institute of Psychology, University of Hamburg, Hamburg, Germany.
| | - Hauke R Heekeren
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
- Executive University Board, University of Hamburg, Hamburg, Germany
| | - Matthew R Nassar
- Robert J. & Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA
- Department of Neuroscience, Brown University, Providence, RI, USA
| |
Collapse
|
4
|
Xu T, Zhang L, Zhou F, Fu K, Gan X, Chen Z, Zhang R, Lan C, Wang L, Kendrick KM, Yao D, Becker B. Distinct neural computations scale the violation of expected reward and emotion in social transgressions. Commun Biol 2025; 8:106. [PMID: 39838081 PMCID: PMC11751440 DOI: 10.1038/s42003-025-07561-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2024] [Accepted: 01/15/2025] [Indexed: 01/23/2025] Open
Abstract
Traditional decision-making models conceptualize humans as adaptive learners utilizing the differences between expected and actual rewards (prediction errors, PEs) to maximize outcomes, but rarely consider the influence of violations of emotional expectations (emotional PEs) and how it differs from reward PEs. Here, we conducted a fMRI experiment (n = 43) using a modified Ultimatum Game to examine how reward and emotional PEs affect punishment decisions in terms of rejecting unfair offers. Our results revealed that reward relative to emotional PEs exerted a stronger prediction to punishment decisions. On the neural level, the left dorsomedial prefrontal cortex (dmPFC) was strongly activated during reward receipt whereas the emotions engaged the bilateral anterior insula. Reward and emotional PEs were also encoded differently in brain-wide multivariate patterns, with a more sensitive neural signature observed within fronto-insular circuits for reward PE. We further identified a fronto-insular network encompassing the left anterior cingulate cortex, bilateral insula, left dmPFC and inferior frontal gyrus that encoded punishment decisions. In addition, a stronger fronto-insular pattern expression under reward PE predicted more punishment decisions. These findings underscore that reward and emotional violations interact to shape decisions in complex social interactions, while the underlying neurofunctional PEs computations are distinguishable.
Collapse
Affiliation(s)
- Ting Xu
- Faculty of Psychology, Southwest University, Chongqing, China
- Key Laboratory of Cognition and Personality, Ministry of Education, Chongqing, China
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Lei Zhang
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
- Institute for Mental Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Feng Zhou
- Faculty of Psychology, Southwest University, Chongqing, China
- Key Laboratory of Cognition and Personality, Ministry of Education, Chongqing, China
| | - Kun Fu
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Xianyang Gan
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Zhiyi Chen
- Faculty of Psychology, Southwest University, Chongqing, China
- Key Laboratory of Cognition and Personality, Ministry of Education, Chongqing, China
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Ran Zhang
- Faculty of Psychology, Southwest University, Chongqing, China
- Key Laboratory of Cognition and Personality, Ministry of Education, Chongqing, China
| | - Chunmei Lan
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Lan Wang
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Keith M Kendrick
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Dezhong Yao
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Benjamin Becker
- Department of Psychology, The University of Hong Kong, Hong Kong, China.
- State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong, China.
| |
Collapse
|
5
|
Suganuma H, Naito A, Katahira K, Kameda T. When to stop social learning from a predecessor in an information-foraging task. EVOLUTIONARY HUMAN SCIENCES 2025; 7:e2. [PMID: 39935447 PMCID: PMC11810515 DOI: 10.1017/ehs.2024.29] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Revised: 05/04/2024] [Accepted: 06/01/2024] [Indexed: 02/13/2025] Open
Abstract
Striking a balance between individual and social learning is one of the key capabilities that support adaptation under uncertainty. Although intergenerational transmission of information is ubiquitous, little is known about when and how newcomers switch from learning loyally from preceding models to exploring independently. Using a behavioural experiment, we investigated how social information available from a preceding demonstrator affects the timing of becoming independent and individual performance thereafter. Participants worked on a 30-armed bandit task for 100 trials. For the first 15 trials, participants simply observed the choices of a demonstrator who had accumulated more knowledge about the environment and passively received rewards from the demonstrator's choices. Thereafter, participants could switch to making independent choices at any time. We had three conditions differing in the social information available from the demonstrator: choice only, reward only or both. Results showed that both participants' strategies about when to stop observational learning and their behavioural patterns after independence depended on the available social information. Participants generally failed to make the best use of previously observed social information in their subsequent independent choices, suggesting the importance of direct communication beyond passive observation for better intergenerational transmission under uncertainty. Implications for cultural evolution are discussed.
Collapse
Affiliation(s)
- Hidezo Suganuma
- Department of Social Psychology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Aoi Naito
- School of Environmental Society, Institute of Science Tokyo, 3-3-6 Shibaura, Minato-ku, Tokyo 108-0023, Japan
- Japan Society for the Promotion of Science, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo 102-0083, Japan
| | - Kentaro Katahira
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki 305-8566, Japan
| | - Tatsuya Kameda
- Faculty of Mathematical Informatics, Meiji Gakuin University, 1518 Kamikuratachou, Totsuka-ku, Yokohama, 244-8539 Japan
- Center for Interdisciplinary Informatics, Meiji Gakuin University, 1-2-37 Shirokanedai, Minato-ku, Tokyo 108-8636, Japan
- Center for Experimental Research in Social Sciences, Hokkaido University, N10W7, Kita-ku, Sapporo, Hokkaido 060-0810, Japan
- Brain Science Institute, Tamagawa University, 6-1-1 Tamagawagakuen, Machida, Tokyo, 194-8610 Japan
| |
Collapse
|
6
|
Schultner DT, Stillerman BS, Lindström BR, Hackel LM, Hagen DR, Jostmann NB, Amodio DM. Transmission of societal stereotypes to individual-level prejudice through instrumental learning. Proc Natl Acad Sci U S A 2024; 121:e2414518121. [PMID: 39485797 PMCID: PMC11551433 DOI: 10.1073/pnas.2414518121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Accepted: 09/26/2024] [Indexed: 11/03/2024] Open
Abstract
How are societal stereotypes transmitted to individual-level group preferences? We propose that exposure to a stereotype, regardless of whether one agrees with it, can shape how one experiences and learns from interactions with members of the stereotyped group, such that it induces individual-level prejudice-a process involving the interplay of semantic knowledge and instrumental learning. In a series of experiments, participants interacted with players from two groups, described with either positive or negative stereotypes, in a reinforcement learning (RL) task presented as a money-sharing game. Although players' actual sharing rates were equated between groups, participants formed more positive reward associations with players from positively stereotyped than negatively stereotyped groups. This effect persisted even when stereotypes were described as unreliable and participants were instructed to ignore them. Computational modeling revealed that this preference was due to stereotype effects on priors regarding group members' behavior as well as the learning rates through which reward associations were updated in response to player feedback. We then show that these stereotype-induced preferences, once formed, spread unwittingly to others who observe these interactions, illustrating a pathway through which stereotypes may be transmitted and propagated between society and individuals. By identifying a mechanism through which stereotype knowledge can bypass explicit beliefs to induce prejudice, via the interplay of semantic and instrumental learning processes, these findings illuminate the impact of stereotype messages on the formation and propagation of individual-level prejudice.
Collapse
Affiliation(s)
- David T. Schultner
- Department of Psychology, University of Amsterdam, Amsterdam1001NK, The Netherlands
- Department of Clinical Neuroscience, Division of Psychology, Karolinska Institutet, Stockholm17177, Sweden
| | | | - Björn R. Lindström
- Department of Clinical Neuroscience, Division of Psychology, Karolinska Institutet, Stockholm17177, Sweden
| | - Leor M. Hackel
- Department of Psychology, University of Southern California, Los Angeles, CA90089
| | - Damaris R. Hagen
- Department of Psychology, University of Amsterdam, Amsterdam1001NK, The Netherlands
| | - Nils B. Jostmann
- Department of Psychology, University of Amsterdam, Amsterdam1001NK, The Netherlands
| | - David M. Amodio
- Department of Psychology, University of Amsterdam, Amsterdam1001NK, The Netherlands
| |
Collapse
|
7
|
Lehmann K, Bolis D, Friston KJ, Schilbach L, Ramstead MJD, Kanske P. An Active-Inference Approach to Second-Person Neuroscience. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2024; 19:931-951. [PMID: 37565656 PMCID: PMC11539477 DOI: 10.1177/17456916231188000] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/12/2023]
Abstract
Social neuroscience has often been criticized for approaching the investigation of the neural processes that enable social interaction and cognition from a passive, detached, third-person perspective, without involving any real-time social interaction. With the emergence of second-person neuroscience, investigators have uncovered the unique complexity of neural-activation patterns in actual, real-time interaction. Social cognition that occurs during social interaction is fundamentally different from that unfolding during social observation. However, it remains unclear how the neural correlates of social interaction are to be interpreted. Here, we leverage the active-inference framework to shed light on the mechanisms at play during social interaction in second-person neuroscience studies. Specifically, we show how counterfactually rich mutual predictions, real-time bodily adaptation, and policy selection explain activation in components of the default mode, salience, and frontoparietal networks of the brain, as well as in the basal ganglia. We further argue that these processes constitute the crucial neural processes that underwrite bona fide social interaction. By placing the experimental approach of second-person neuroscience on the theoretical foundation of the active-inference framework, we inform the field of social neuroscience about the mechanisms of real-life interactions. We thereby contribute to the theoretical foundations of empirical second-person neuroscience.
Collapse
Affiliation(s)
- Konrad Lehmann
- Clinical Psychology and Behavioral Neuroscience, Faculty of Psychology, Technische Universität Dresden, Germany
| | - Dimitris Bolis
- Laboratory for Autism and Neurodevelopmental Disorders, Center for Neuroscience and Cognitive Systems @UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy
- Independent Max Planck Research Group for Social Neuroscience, Max Planck Institute of Psychiatry, Munich, Germany
- National Institute for Physiological Sciences, Okazaki, Japan
- Centre for Philosophy of Science, University of Lisbon, Portugal
| | - Karl J. Friston
- Wellcome Centre for Human Neuroimaging, University College London, UK
- VERSES AI Research Lab, Los Angeles, CA, USA
| | - Leonhard Schilbach
- Independent Max Planck Research Group for Social Neuroscience, Max Planck Institute of Psychiatry, Munich, Germany
- Department of Psychiatry and Psychotherapy, University Hospital, Ludwig Maximilians Universität, Munich, Germany
- Department of General Psychiatry 2, Clinics of the Heinrich Heine University Düsseldorf, Germany
| | - Maxwell J. D. Ramstead
- Wellcome Centre for Human Neuroimaging, University College London, UK
- VERSES AI Research Lab, Los Angeles, CA, USA
| | - Philipp Kanske
- Clinical Psychology and Behavioral Neuroscience, Faculty of Psychology, Technische Universität Dresden, Germany
| |
Collapse
|
8
|
Lamba A, Frank MJ, FeldmanHall O. Keeping an Eye Out for Change: Anxiety Disrupts Adaptive Resolution of Policy Uncertainty. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2024; 9:1188-1198. [PMID: 39069235 DOI: 10.1016/j.bpsc.2024.07.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Revised: 07/17/2024] [Accepted: 07/17/2024] [Indexed: 07/30/2024]
Abstract
BACKGROUND Human learning unfolds under uncertainty. Uncertainty is heterogeneous with different forms exerting distinct influences on learning. While one can be uncertain about what to do to maximize rewarding outcomes, known as policy uncertainty, one can also be uncertain about general world knowledge, known as epistemic uncertainty (EU). In complex and naturalistic environments such as the social world, adaptive learning may hinge on striking a balance between attending to and resolving each type of uncertainty. Prior work illustrates that people with anxiety-those with increased threat and uncertainty sensitivity-learn less from aversive outcomes, particularly as outcomes become more uncertain. How does a learner adaptively trade-off between attending to these distinct sources of uncertainty to successfully learn about their social environment? METHODS We developed a novel eye-tracking method to capture highly granular estimates of policy uncertainty and EU based on gaze patterns and pupil diameter (a physiological estimate of arousal). RESULTS These empirically derived uncertainty measures revealed that humans (N = 94) flexibly switched between resolving policy uncertainty and EU to adaptively learn about which individuals can be trusted and which should be avoided. However, those with increased anxiety (n = 49) did not flexibly switch between resolving policy uncertainty and EU and instead expressed less uncertainty overall. CONCLUSIONS Combining modeling and eye-tracking techniques, we show that altered learning in people with anxiety emerged from an insensitivity to policy uncertainty and rigid choice policies, leading to maladaptive behaviors with untrustworthy people.
Collapse
Affiliation(s)
- Amrita Lamba
- Department of Cognitive and Psychological Sciences, Brown University, Providence, Rhode Island; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts
| | - Michael J Frank
- Department of Cognitive and Psychological Sciences, Brown University, Providence, Rhode Island; Carney Institute of Brain Sciences, Brown University, Providence, Rhode Island
| | - Oriel FeldmanHall
- Department of Cognitive and Psychological Sciences, Brown University, Providence, Rhode Island; Carney Institute of Brain Sciences, Brown University, Providence, Rhode Island.
| |
Collapse
|
9
|
Piray P, Daw ND. Computational processes of simultaneous learning of stochasticity and volatility in humans. Nat Commun 2024; 15:9073. [PMID: 39433765 PMCID: PMC11494056 DOI: 10.1038/s41467-024-53459-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 10/10/2024] [Indexed: 10/23/2024] Open
Abstract
Making adaptive decisions requires predicting outcomes, and this in turn requires adapting to uncertain environments. This study explores computational challenges in distinguishing two types of noise influencing predictions: volatility and stochasticity. Volatility refers to diffusion noise in latent causes, requiring a higher learning rate, while stochasticity introduces moment-to-moment observation noise and reduces learning rate. Dissociating these effects is challenging as both increase the variance of observations. Previous research examined these factors mostly separately, but it remains unclear whether and how humans dissociate them when they are played off against one another. In two large-scale experiments, through a behavioral prediction task and computational modeling, we report evidence of humans dissociating volatility and stochasticity solely based on their observations. We observed contrasting effects of volatility and stochasticity on learning rates, consistent with statistical principles. These results are consistent with a computational model that estimates volatility and stochasticity by balancing their dueling effects.
Collapse
Affiliation(s)
- Payam Piray
- Department of Psychology, University of Southern California, Los Angeles, CA, USA.
| | - Nathaniel D Daw
- Department of Psychology, and Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| |
Collapse
|
10
|
Scott DN, Mukherjee A, Nassar MR, Halassa MM. Thalamocortical architectures for flexible cognition and efficient learning. Trends Cogn Sci 2024; 28:739-756. [PMID: 38886139 PMCID: PMC11305962 DOI: 10.1016/j.tics.2024.05.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 05/12/2024] [Accepted: 05/13/2024] [Indexed: 06/20/2024]
Abstract
The brain exhibits a remarkable ability to learn and execute context-appropriate behaviors. How it achieves such flexibility, without sacrificing learning efficiency, is an important open question. Neuroscience, psychology, and engineering suggest that reusing and repurposing computations are part of the answer. Here, we review evidence that thalamocortical architectures may have evolved to facilitate these objectives of flexibility and efficiency by coordinating distributed computations. Recent work suggests that distributed prefrontal cortical networks compute with flexible codes, and that the mediodorsal thalamus provides regularization to promote efficient reuse. Thalamocortical interactions resemble hierarchical Bayesian computations, and their network implementation can be related to existing gating, synchronization, and hub theories of thalamic function. By reviewing recent findings and providing a novel synthesis, we highlight key research horizons integrating computation, cognition, and systems neuroscience.
Collapse
Affiliation(s)
- Daniel N Scott
- Department of Neuroscience, Brown University, Providence, RI, USA; Robert J. and Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| | - Arghya Mukherjee
- Department of Neuroscience, Tufts University School of Medicine, Boston, MA, USA
| | - Matthew R Nassar
- Department of Neuroscience, Brown University, Providence, RI, USA; Robert J. and Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA
| | - Michael M Halassa
- Department of Neuroscience, Tufts University School of Medicine, Boston, MA, USA; Department of Psychiatry, Tufts University School of Medicine, Boston, MA, USA.
| |
Collapse
|
11
|
Hackel LM, Kalkstein DA, Mende-Siedlecki P. Simplifying social learning. Trends Cogn Sci 2024; 28:428-440. [PMID: 38331595 DOI: 10.1016/j.tics.2024.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 01/16/2024] [Accepted: 01/17/2024] [Indexed: 02/10/2024]
Abstract
Social learning is complex, but people often seem to navigate social environments with ease. This ability creates a puzzle for traditional accounts of reinforcement learning (RL) that assume people negotiate a tradeoff between easy-but-simple behavior (model-free learning) and complex-but-difficult behavior (e.g., model-based learning). We offer a theoretical framework for resolving this puzzle: although social environments are complex, people have social expertise that helps them behave flexibly with low cognitive cost. Specifically, by using familiar concepts instead of focusing on novel details, people can turn hard learning problems into simpler ones. This ability highlights social learning as a prototype for studying cognitive simplicity in the face of environmental complexity and identifies a role for conceptual knowledge in everyday reward learning.
Collapse
Affiliation(s)
- Leor M Hackel
- University of Southern California, Los Angeles, CA 90089, USA.
| | | | | |
Collapse
|
12
|
Barnby JM, Bell V, Deeley Q, Mehta MA, Moutoussis M. D2/D3 dopamine supports the precision of mental state inferences and self-relevance of joint social outcomes. NATURE. MENTAL HEALTH 2024; 2:562-573. [PMID: 38746690 PMCID: PMC11088992 DOI: 10.1038/s44220-024-00220-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 02/22/2024] [Indexed: 01/06/2025]
Abstract
Striatal dopamine is important in paranoid attributions, although its computational role in social inference remains elusive. We employed a simple game-theoretic paradigm and computational model of intentional attributions to investigate the effects of dopamine D2/D3 antagonism on ongoing mental state inference following social outcomes. Haloperidol, compared with the placebo, enhanced the impact of partner behaviour on beliefs about the harmful intent of partners, and increased learning from recent encounters. These alterations caused substantial changes to model covariation and negative correlations between self-interest and harmful intent attributions. Our findings suggest that haloperidol improves belief flexibility about others and simultaneously reduces the self-relevance of social observations. Our results may reflect the role of D2/D3 dopamine in supporting self-relevant mentalising. Our data and model bridge theory between general and social accounts of value representation. We demonstrate initial evidence for the sensitivity of our model and short social paradigm to drug intervention and clinical dimensions, allowing distinctions between mechanisms that operate across traits and states.
Collapse
Affiliation(s)
- J. M. Barnby
- Department of Psychology, Royal Holloway, University of London, London, UK
- King’s College London, Cultural and Social Neuroscience Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, University of London, London, UK
| | - V. Bell
- Clinical, Educational, and Health Psychology, University College London, London, UK
| | - Q. Deeley
- King’s College London, Cultural and Social Neuroscience Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, University of London, London, UK
| | - M. A. Mehta
- King’s College London, Cultural and Social Neuroscience Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, University of London, London, UK
| | - M. Moutoussis
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing, University College London, London, UK
| |
Collapse
|
13
|
Hitchcock PF, Frank MJ. From Tripping and Falling to Ruminating and Worrying: A Meta-Control Account of Repetitive Negative Thinking. Curr Opin Behav Sci 2024; 56:101356. [PMID: 39130377 PMCID: PMC11314892 DOI: 10.1016/j.cobeha.2024.101356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Repetitive negative thinking (RNT) is a transdiagnostic construct that encompasses rumination and worry, yet what precisely is shared between rumination and worry is unclear. To clarify this, we develop a meta-control account of RNT. Meta-control refers to the reinforcement and control of mental behavior via similar computations as reinforce and control motor behavior. We propose rumination and worry are coarse terms for failure in meta-control, just as tripping and falling are coarse terms for failure in motor control. We delineate four meta-control stages and risk factors increasing the chance of failure at each, including open-ended thoughts (stage 1), individual differences influencing subgoal execution (stage 2) and switching (stage 3), and challenges inherent to learning adaptive mental behavior (stage 4). Distinguishing these stages therefore elucidates diverse processes that lead to the same behavior of excessive RNT. Our account also subsumes prominent clinical accounts of RNT into a computational cognitive neuroscience framework.
Collapse
Affiliation(s)
- Peter F. Hitchcock
- Department of Psychology, Emory University, Atlanta, GA
- Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI
| | - Michael J. Frank
- Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI
- Carney Institute for Brain Science, Brown University, Providence, RI
| |
Collapse
|
14
|
Schulz L, Bhui R. Political reinforcement learners. Trends Cogn Sci 2024; 28:210-222. [PMID: 38195364 DOI: 10.1016/j.tics.2023.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 12/09/2023] [Accepted: 12/11/2023] [Indexed: 01/11/2024]
Abstract
Politics can seem home to the most calculating and yet least rational elements of humanity. How might we systematically characterize this spectrum of political cognition? Here, we propose reinforcement learning (RL) as a unified framework to dissect the political mind. RL describes how agents algorithmically navigate complex and uncertain domains like politics. Through this computational lens, we outline three routes to political differences, stemming from variability in agents' conceptions of a problem, the cognitive operations applied to solve the problem, or the backdrop of information available from the environment. A computational vantage on maladies of the political mind offers enhanced precision in assessing their causes, consequences, and cures.
Collapse
Affiliation(s)
- Lion Schulz
- Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Max-Planck-Ring 8-14, 72076 Tübingen, Germany.
| | - Rahul Bhui
- Sloan School of Management and Institute for Data, Systems, and Society, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
15
|
Mayo O, Shamay-Tsoory S. Dynamic mutual predictions during social learning: A computational and interbrain model. Neurosci Biobehav Rev 2024; 157:105513. [PMID: 38135267 DOI: 10.1016/j.neubiorev.2023.105513] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 10/27/2023] [Accepted: 12/18/2023] [Indexed: 12/24/2023]
Abstract
During social interactions, we constantly learn about the thoughts, feelings, and personality traits of our interaction partners. Learning in social interactions is critical for bond formation and acquiring knowledge. Importantly, this type of learning is typically bi-directional, as both partners learn about each other simultaneously. Here we review the literature on social learning and propose a new computational and neural model characterizing mutual predictions that take place within and between interactions. According to our model, each partner in the interaction attempts to minimize the prediction error of the self and the interaction partner. In most cases, these inferential models become similar over time, thus enabling mutual understanding to develop. At the neural level, this type of social learning may be supported by interbrain plasticity, defined as a change in interbrain coupling over time in neural networks associated with social learning, among them the mentalizing network, the observation-execution system, and the hippocampus. The mutual prediction model constitutes a promising means of providing empirically verifiable accounts of how relationships develop over time.
Collapse
Affiliation(s)
- Oded Mayo
- The Department of Psychology, University of Haifa, Haifa, Israel.
| | | |
Collapse
|
16
|
Hemmatian B, Varshney LR, Pi F, Barbey AK. The utilitarian brain: Moving beyond the Free Energy Principle. Cortex 2024; 170:69-79. [PMID: 38135613 DOI: 10.1016/j.cortex.2023.11.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/28/2023] [Accepted: 11/28/2023] [Indexed: 12/24/2023]
Abstract
The Free Energy Principle (FEP) is a normative computational framework for iterative reduction of prediction error and uncertainty through perception-intervention cycles that has been presented as a potential unifying theory of all brain functions (Friston, 2006). Any theory hoping to unify the brain sciences must be able to explain the mechanisms of decision-making, an important cognitive faculty, without the addition of independent, irreducible notions. This challenge has been accepted by several proponents of the FEP (Friston, 2010; Gershman, 2019). We evaluate attempts to reduce decision-making to the FEP, using Lucas' (2005) meta-theory of the brain's contextual constraints as a guidepost. We find reductive variants of the FEP for decision-making unable to explain behavior in certain types of diagnostic, predictive, and multi-armed bandit tasks. We trace the shortcomings to the core theory's lack of an adequate notion of subjective preference or "utility", a concept central to decision-making and grounded in the brain's biological reality. We argue that any attempts to fully reduce utility to the FEP would require unrealistic assumptions, making the principle an unlikely candidate for unifying brain science. We suggest that researchers instead attempt to identify contexts in which either informational or independent reward constraints predominate, delimiting the FEP's area of applicability. To encourage this type of research, we propose a two-factor formal framework that can subsume any FEP model and allows experimenters to compare the contributions of informational versus reward constraints to behavior.
Collapse
Affiliation(s)
- Babak Hemmatian
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, USA
| | - Lav R Varshney
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, USA
| | - Frederick Pi
- Department of Cognitive Science, University of California San Diego, USA
| | - Aron K Barbey
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, USA; Center for Brain, Biology and Behavior, University of Nebraska Lincoln, USA.
| |
Collapse
|
17
|
Abstract
Humans often generalize rewarding experiences across abstract social roles. Theories of reward learning suggest that people generalize through model-based learning, but such learning is cognitively costly. Why do people seem to generalize across social roles with ease? Humans are social experts who easily recognize social roles that reflect familiar semantic concepts (e.g., "helper" or "teacher"). People may associate these roles with model-free reward (e.g., learning that helpers are rewarding), allowing them to generalize easily (e.g., interacting with novel individuals identified as helpers). In four online experiments with U.S. adults (N = 577), we found evidence that social concepts ease complex learning (people generalize more and at faster speed) and that people attach reward directly to abstract roles (they generalize even when roles are unrelated to task structure). These results demonstrate how familiar concepts allow complex behavior to emerge from simple strategies, highlighting social interaction as a prototype for studying cognitive ease in the face of environmental complexity.
Collapse
Affiliation(s)
- Leor M Hackel
- Department of Psychology, University of Southern California
| | | |
Collapse
|
18
|
Alon N, Schulz L, Rosenschein JS, Dayan P. A (Dis-)information Theory of Revealed and Unrevealed Preferences: Emerging Deception and Skepticism via Theory of Mind. Open Mind (Camb) 2023; 7:608-624. [PMID: 37840764 PMCID: PMC10575559 DOI: 10.1162/opmi_a_00097] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 07/19/2023] [Indexed: 10/17/2023] Open
Abstract
In complex situations involving communication, agents might attempt to mask their intentions, exploiting Shannon's theory of information as a theory of misinformation. Here, we introduce and analyze a simple multiagent reinforcement learning task where a buyer sends signals to a seller via its actions, and in which both agents are endowed with a recursive theory of mind. We show that this theory of mind, coupled with pure reward-maximization, gives rise to agents that selectively distort messages and become skeptical towards one another. Using information theory to analyze these interactions, we show how savvy buyers reduce mutual information between their preferences and actions, and how suspicious sellers learn to reinterpret or discard buyers' signals in a strategic manner.
Collapse
Affiliation(s)
- Nitay Alon
- Department of Computer Science, The Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Lion Schulz
- Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | | | - Peter Dayan
- Department of Computer Science, The Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Computer Science, University of Tübingen, Tübingen, Germany
| |
Collapse
|
19
|
Barnby JM, Dayan P, Bell V. Formalising social representation to explain psychiatric symptoms. Trends Cogn Sci 2023; 27:317-332. [PMID: 36609016 DOI: 10.1016/j.tics.2022.12.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 12/09/2022] [Accepted: 12/13/2022] [Indexed: 01/06/2023]
Abstract
Recent work in social cognition has moved beyond a focus on how people process social rewards to examine how healthy people represent other agents and how this is altered in psychiatric disorders. However, formal modelling of social representation has not kept pace with these changes, impeding our understanding of how core aspects of social cognition function, and fail, in psychopathology. Here, we suggest that belief-based computational models provide a basis for an integrated sociocognitive approach to psychiatry, with the potential to address important but unexamined pathologies of social representation, such as maladaptive schemas and illusory social agents.
Collapse
Affiliation(s)
- Joseph M Barnby
- Social Computation and Cognitive Representation Lab, Department of Psychology, Royal Holloway, University of London, Egham TW20 0EX, UK.
| | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, 72076, Germany; University of Tübingen, Tübingen, 72074, Germany
| | - Vaughan Bell
- Clinical, Educational, and Health Psychology, University College London, London WC1E 7HB, UK; South London and Maudsley NHS Foundation Trust, London SE5 8AZ, UK
| |
Collapse
|
20
|
Kao CH, Feng GW, Hur JK, Jarvis H, Rutledge RB. Computational models of subjective feelings in psychiatry. Neurosci Biobehav Rev 2023; 145:105008. [PMID: 36549378 PMCID: PMC9990828 DOI: 10.1016/j.neubiorev.2022.105008] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 12/02/2022] [Accepted: 12/15/2022] [Indexed: 12/23/2022]
Abstract
Research in computational psychiatry is dominated by models of behavior. Subjective experience during behavioral tasks is not well understood, even though it should be relevant to understanding the symptoms of psychiatric disorders. Here, we bridge this gap and review recent progress in computational models for subjective feelings. For example, happiness reflects not how well people are doing, but whether they are doing better than expected. This dependence on recent reward prediction errors is intact in major depression, although depressive symptoms lower happiness during tasks. Uncertainty predicts subjective feelings of stress in volatile environments. Social prediction errors influence feelings of self-worth more in individuals with low self-esteem despite a reduced willingness to change beliefs due to social feedback. Measuring affective state during behavioral tasks provides a tool for understanding psychiatric symptoms that can be dissociable from behavior. When smartphone tasks are collected longitudinally, subjective feelings provide a potential means to bridge the gap between lab-based behavioral tasks and real-life behavior, emotion, and psychiatric symptoms.
Collapse
Affiliation(s)
- Chang-Hao Kao
- Department of Psychology, Yale University, New Haven, CT, USA.
| | - Gloria W Feng
- Department of Psychology, Yale University, New Haven, CT, USA
| | - Jihyun K Hur
- Department of Psychology, Yale University, New Haven, CT, USA
| | - Huw Jarvis
- Department of Psychology, Yale University, New Haven, CT, USA; Turner Institute for Brain and Mental Health, Monash University, Clayton, Victoria, Australia; School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Robb B Rutledge
- Department of Psychology, Yale University, New Haven, CT, USA; Wellcome Centre for Human Neuroimaging, University College London, London, UK.
| |
Collapse
|
21
|
Flechsenhar A, Kanske P, Krach S, Korn C, Bertsch K. The (un)learning of social functions and its significance for mental health. Clin Psychol Rev 2022; 98:102204. [PMID: 36216722 DOI: 10.1016/j.cpr.2022.102204] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 08/11/2022] [Accepted: 09/23/2022] [Indexed: 01/27/2023]
Abstract
Social interactions are dynamic, context-dependent, and reciprocal events that influence prospective strategies and require constant practice and adaptation. This complexity of social interactions creates several research challenges. We propose a new framework encouraging future research to investigate not only individual differences in capacities relevant for social functioning and their underlying mechanisms, but also the flexibility to adapt or update one's social abilities. We suggest three key capacities relevant for social functioning: (1) social perception, (2) sharing emotions or empathizing, and (3) mentalizing. We elaborate on how adaptations in these capacities may be investigated on behavioral and neural levels. Research on these flexible adaptations of one's social behavior is needed to specify how humans actually "learn to be social". Learning to adapt implies plasticity of the relevant brain networks involved in the underlying social processes, indicating that social abilities are malleable for different contexts. To quantify such measures, researchers need to find ways to investigate learning through dynamic changes in adaptable social paradigms and examine several factors influencing social functioning within the three aformentioned social key capacities. This framework furthers insight concerning individual differences, provides a holistic approach to social functioning, and may improve interventions for ameliorating social abilities in patients.
Collapse
Affiliation(s)
- Aleya Flechsenhar
- Department Clinical Psychology and Psychotherapy, Ludwig-Maximilians-University Munich, Germany.
| | - Philipp Kanske
- Institute of Clinical Psychology and Psychotherapy, Technische Universität Dresden, Germany
| | - Sören Krach
- Department of Psychiatry and Psychotherapy, University of Lübeck, Germany
| | - Christoph Korn
- Section Social Neuroscience, Department of General Psychiatry, Center for Psychosocial Medicine, Heidelberg University, Heidelberg, Germany
| | - Katja Bertsch
- Department Clinical Psychology and Psychotherapy, Ludwig-Maximilians-University Munich, Germany; NeuroImaging Core Unit Munich (NICUM), University Hospital LMU, Munich, Germany; Department of General Psychiatry, Center for Psychosocial Medicine, Heidelberg University, Heidelberg, Germany
| |
Collapse
|
22
|
Ho MK, Saxe R, Cushman F. Planning with Theory of Mind. Trends Cogn Sci 2022; 26:959-971. [PMID: 36089494 DOI: 10.1016/j.tics.2022.08.003] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 08/08/2022] [Accepted: 08/09/2022] [Indexed: 01/12/2023]
Abstract
Understanding Theory of Mind should begin with an analysis of the problems it solves. The traditional answer is that Theory of Mind is used for predicting others' thoughts and actions. However, the same Theory of Mind is also used for planning to change others' thoughts and actions. Planning requires that Theory of Mind consists of abstract structured causal representations and supports efficient search and selection from innumerable possible actions. Theory of Mind contrasts with less cognitively demanding alternatives: statistical predictive models of other people's actions, or model-free reinforcement of actions by their effects on other people. Theory of Mind is likely used to plan novel interventions and predict their effects, for example, in pedagogy, emotion regulation, and impression management.
Collapse
Affiliation(s)
- Mark K Ho
- Department of Computer Science, Princeton University, Princeton, NJ, USA; Department of Psychology, Princeton University, Princeton, NJ, USA.
| | - Rebecca Saxe
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA
| | - Fiery Cushman
- Department of Psychology, Harvard University, Cambridge, MA, USA
| |
Collapse
|
23
|
Hofmans L, van den Bos W. Social learning across adolescence: A Bayesian neurocognitive perspective. Dev Cogn Neurosci 2022; 58:101151. [PMID: 36183664 PMCID: PMC9526184 DOI: 10.1016/j.dcn.2022.101151] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 09/14/2022] [Accepted: 09/15/2022] [Indexed: 01/13/2023] Open
Abstract
Adolescence is a period of social re-orientation in which we are generally more prone to peer influence and the updating of our beliefs based on social information, also called social learning, than in any other stage of our life. However, how do we know when to use social information and whose information to use and how does this ability develop across adolescence? Here, we review the social learning literature from a behavioral, neural and computational viewpoint, focusing on the development of brain systems related to executive functioning, value-based decision-making and social cognition. We put forward a Bayesian reinforcement learning framework that incorporates social learning about value associated with particular behavior and uncertainty in our environment and experiences. We discuss how this framework can inform us about developmental changes in social learning, including how the assessment of uncertainty and the ability to adaptively discriminate between information from different social sources change across adolescence. By combining reward-based decision-making in the domains of both informational and normative influence, this framework explains both negative and positive social peer influence in adolescence.
Collapse
Affiliation(s)
- Lieke Hofmans
- Department of Developmental Psychology, University of Amsterdam, Amsterdam, the Netherlands,Correspondence to: Nieuwe Achtergracht 129, room G1.05, 1018WS Amsterdam, the Netherlands.
| | - Wouter van den Bos
- Department of Developmental Psychology, University of Amsterdam, Amsterdam, the Netherlands,Amsterdam Brain and Cognition Center, University of Amsterdam, Amsterdam, the Netherlands,Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| |
Collapse
|
24
|
Jiang Y, Wu H, Mi Q, Zhu L. Neurocomputations of strategic behavior: From iterated to novel interactions. WIRES COGNITIVE SCIENCE 2022; 13:e1598. [PMID: 35441465 PMCID: PMC9542218 DOI: 10.1002/wcs.1598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 03/27/2022] [Accepted: 03/29/2022] [Indexed: 11/15/2022]
Abstract
Strategic interactions, where an individual's payoff depends on the decisions of multiple intelligent agents, are ubiquitous among social animals. They span a variety of important social behaviors such as competition, cooperation, coordination, and communication, and often involve complex, intertwining cognitive operations ranging from basic reward processing to higher‐order mentalization. Here, we review the progress and challenges in probing the neural and cognitive mechanisms of strategic behavior of interacting individuals, drawing an analogy to recent developments in studies of reward‐seeking behavior, in particular, how research focuses in the field of strategic behavior have been expanded from adaptive behavior based on trial‐and‐error to flexible decisions based on limited prior experience. We highlight two important research questions in the field of strategic behavior: (i) How does the brain exploit past experience for learning to behave strategically? and (ii) How does the brain decide what to do in novel strategic situations in the absence of direct experience? For the former, we discuss the utility of learning models that have effectively connected various types of neural data with strategic learning behavior and helped elucidate the interplay among multiple learning processes. For the latter, we review the recent evidence and propose a neural generative mechanism by which the brain makes novel strategic choices through simulating others' goal‐directed actions according to rational or bounded‐rational principles obtained through indirect social knowledge. This article is categorized under:Economics > Interactive Decision‐Making Psychology > Reasoning and Decision Making Neuroscience > Cognition
Collapse
Affiliation(s)
- Yaomin Jiang
- School of Psychological and Cognitive Sciences, Beijing Key Laboratory of Behavior and Mental Health, IDG/McGovern Institute for Brain Research, Peking‐Tsinghua Center for Life Sciences Peking University Beijing China
| | - Hai‐Tao Wu
- School of Psychological and Cognitive Sciences, Beijing Key Laboratory of Behavior and Mental Health, IDG/McGovern Institute for Brain Research, Peking‐Tsinghua Center for Life Sciences Peking University Beijing China
| | - Qingtian Mi
- School of Psychological and Cognitive Sciences, Beijing Key Laboratory of Behavior and Mental Health, IDG/McGovern Institute for Brain Research, Peking‐Tsinghua Center for Life Sciences Peking University Beijing China
| | - Lusha Zhu
- School of Psychological and Cognitive Sciences, Beijing Key Laboratory of Behavior and Mental Health, IDG/McGovern Institute for Brain Research, Peking‐Tsinghua Center for Life Sciences Peking University Beijing China
| |
Collapse
|
25
|
Barnby JM, Mehta MA, Moutoussis M. The computational relationship between reinforcement learning, social inference, and paranoia. PLoS Comput Biol 2022; 18:e1010326. [PMID: 35877675 PMCID: PMC9352206 DOI: 10.1371/journal.pcbi.1010326] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 08/04/2022] [Accepted: 06/23/2022] [Indexed: 11/18/2022] Open
Abstract
Theoretical accounts suggest heightened uncertainty about the state of the world underpin aberrant belief updates, which in turn increase the risk of developing a persecutory delusion. However, this raises the question as to how an agent's uncertainty may relate to the precise phenomenology of paranoia, as opposed to other qualitatively different forms of belief. We tested whether the same population (n = 693) responded similarly to non-social and social contingency changes in a probabilistic reversal learning task and a modified repeated reversal Dictator game, and the impact of paranoia on both. We fitted computational models that included closely related parameters that quantified the rigidity across contingency reversals and the uncertainty about the environment/partner. Consistent with prior work we show that paranoia was associated with uncertainty around a partner's behavioural policy and rigidity in harmful intent attributions in the social task. In the non-social task we found that pre-existing paranoia was associated with larger decision temperatures and commitment to suboptimal cards. We show relationships between decision temperature in the non-social task and priors over harmful intent attributions and uncertainty over beliefs about partners in the social task. Our results converge across both classes of model, suggesting paranoia is associated with a general uncertainty over the state of the world (and agents within it) that takes longer to resolve, although we demonstrate that this uncertainty is expressed asymmetrically in social contexts. Our model and data allow the representation of sociocognitive mechanisms that explain persecutory delusions and provide testable, phenomenologically relevant predictions for causal experiments.
Collapse
Affiliation(s)
- Joseph M. Barnby
- Department of Psychology, Royal Holloway, University of London, London, United Kingdom
- Cultural and Social Neuroscience Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, University of London, London, United Kingdom
- Neuropharmacology Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, University of London, London, United Kingdom
| | - Mitul A. Mehta
- Cultural and Social Neuroscience Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, University of London, London, United Kingdom
- Neuropharmacology Group, Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, University of London, London, United Kingdom
| | - Michael Moutoussis
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
- Max-Planck–UCL Centre for Computational Psychiatry and Ageing, University College London, London, United Kingdom
| |
Collapse
|
26
|
A Model of Trust. GAMES 2022. [DOI: 10.3390/g13030039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Trust is central to a large variety of social interactions. Different research fields have empirically and theoretically investigated trust, observing trusting behaviors in different situations and pinpointing their different components and constituents. However, a unifying, computational formalization of those diverse components and constituents of trust is still lacking. Previous work has mainly used computational models borrowed from other fields and developed for other purposes to explain trusting behaviors in empirical paradigms. Here, I computationally formalize verbal models of trust in a simple model (i.e., vulnerability model) that combines current and prospective action values with beliefs and expectancies about a partner’s behavior. By using the classic investment game (IG)—an economic game thought to capture some important features of trusting behaviors in social interactions—I show how variations of a single parameter of the vulnerability model generates behaviors that can be interpreted as different “trust attitudes”. I then show how these behavioral patterns change as a function of an individual’s loss aversion and expectations of the partner’s behavior. I finally show how the vulnerability model can be easily extended in a novel IG paradigm to investigate inferences on different traits of a partner. In particular, I will focus on benevolence and competence—two character traits that have previously been described as determinants of trustworthiness impressions central to trust. The vulnerability model can be employed as is or as a utility function within more complex Bayesian frameworks to fit participants’ behavior in different social environments where actions are associated with subjective values and weighted by individual beliefs about others’ behaviors. Hence, the vulnerability model provides an important building block for future theoretical and empirical work across a variety of research fields.
Collapse
|
27
|
Ai W, Cunningham WA, Lai MC. Reconsidering autistic ‘camouflaging’ as transactional impression management. Trends Cogn Sci 2022; 26:631-645. [DOI: 10.1016/j.tics.2022.05.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 05/02/2022] [Accepted: 05/03/2022] [Indexed: 12/12/2022]
|
28
|
Arzy S, Kaplan R. Transforming Social Perspectives with Cognitive Maps. Soc Cogn Affect Neurosci 2022; 17:939-955. [PMID: 35257155 PMCID: PMC9527473 DOI: 10.1093/scan/nsac017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 12/17/2021] [Accepted: 03/07/2022] [Indexed: 01/29/2023] Open
Abstract
Growing evidence suggests that cognitive maps represent relations between social knowledge similar to how spatial locations are represented in an environment. Notably, the extant human medial temporal lobe literature assumes associations between social stimuli follow a linear associative mapping from an egocentric viewpoint to a cognitive map. Yet, this form of associative social memory doesn't account for a core phenomenon of social interactions in which social knowledge learned via comparisons to the self, other individuals, or social networks are assimilated within a single frame of reference. We argue that hippocampal-entorhinal coordinate transformations, known to integrate egocentric and allocentric spatial cues, inform social perspective switching between the self and others. We present evidence that the hippocampal formation helps inform social interactions by relating self versus other social attribute comparisons to society in general, which can afford rapid and flexible assimilation of knowledge about the relationship between the self and social networks of varying proximities. We conclude by discussing the ramifications of cognitive maps in aiding this social perspective transformation process in states of health and disease.
Collapse
Affiliation(s)
- Shahar Arzy
- Faculty of Medicine and the Department of Cognitive Sciences, Hebrew University of Jerusalem, Jerusalem 91120, Israel
- Department of Neurology, Hadassah Hebrew University Medical School, Jerusalem 91120, Israel
| | - Raphael Kaplan
- Correspondence should be addressed to Raphael Kaplan, Department of Basic Psychology, Clinical Psychology, and Psychobiology, Universitat Jaume I, Avinguda de Vicent Sos Baynat, Castelló de la Plana, Spain. E-mail:
| |
Collapse
|