Computational Neuropsychology and Bayesian Inference

Emergent Aspects of the Integration of Sensory and Motor Functions

This article delves into the intricate mechanisms underlying sensory integration in the executive control of movement, encompassing ideomotor activity, predictive capabilities, and motor control systems. It examines the interplay between motor and sensory functions, highlighting the role of the cortical and subcortical regions of the central nervous system in enhancing environmental interaction. The acquisition of motor skills, procedural memory, and the representation of actions in the brain are discussed emphasizing the significance of mental imagery and training in motor function. The development of this aspect of sensorimotor integration control can help to advance our understanding of the interactions between executive motor control, cortical mechanisms, and consciousness. Bridging theoretical insights with practical applications, it sets the stage for future innovations in clinical rehabilitation, assistive technology, and education. The ongoing exploration of these domains promises to uncover new pathways for enhancing human capability and well-being.

Neural integration of egocentric and allocentric visual cues in the gaze system

A fundamental question in neuroscience is how the brain integrates egocentric (body-centered) and allocentric (landmark-centered) visual cues, but for many years this question was ignored in sensorimotor studies. This changed in recent behavioral experiments, but the underlying physiology of ego/allocentric integration remained largely unstudied. The specific goal of this review is to explain how prefrontal neurons integrate eye-centered and landmark-centered visual codes for optimal gaze behavior. First, we briefly review the whole brain/behavioral mechanisms for ego/allocentric integration in the human and summarize egocentric coding mechanisms in the primate gaze system. We then focus in more depth on cellular mechanisms for ego/allocentric coding in the frontal and supplementary eye fields. We first explain how prefrontal visual responses integrate eye-centered target and landmark codes to produce a transformation toward landmark-centered coordinates. Next, we describe what happens when a landmark shifts during the delay between seeing and acquiring a remembered target, initially resulting in independently coexisting ego/allocentric memory codes. We then describe how these codes are reintegrated in the motor burst for the gaze shift. Deep network simulations suggest that these properties emerge spontaneously for optimal gaze behavior. Finally, we synthesize these observations and relate them to normal brain function through a simplified conceptual model. Together, these results show that integration of visuospatial features continues well beyond visual cortex and suggest a general cellular mechanism for goal-directed visual behavior.

The Many Roles of Precision in Action

Active inference describes (Bayes-optimal) behaviour as being motivated by the minimisation of surprise of one's sensory observations, through the optimisation of a generative model (of the hidden causes of one's sensory data) in the brain. One of active inference's key appeals is its conceptualisation of precision as biasing neuronal communication and, thus, inference within generative models. The importance of precision in perceptual inference is evident-many studies have demonstrated the importance of ensuring precision estimates are correct for normal (healthy) sensation and perception. Here, we highlight the many roles precision plays in action, i.e., the key processes that rely on adequate estimates of precision, from decision making and action planning to the initiation and control of muscle movement itself. Thereby, we focus on the recent development of hierarchical, "mixed" models-generative models spanning multiple levels of discrete and continuous inference. These kinds of models open up new perspectives on the unified description of hierarchical computation, and its implementation, in action. Here, we highlight how these models reflect the many roles of precision in action-from planning to execution-and the associated pathologies if precision estimation goes wrong. We also discuss the potential biological implementation of the associated message passing, focusing on the role of neuromodulatory systems in mediating different kinds of precision.

Visual mismatch negativity in Parkinson's psychosis and potential for testing treatment mechanisms

Psychosis and visual hallucinations are a prevalent non-motor symptom of Parkinson's disease, negatively affecting patients' quality of life and constituting a greater risk for dementia. Understanding neural mechanisms associated to these symptoms is instrumental for treatment development. The mismatch negativity is an event-related potential evoked by a violation in a sequence of sensory events. It is widely considered an index of sensory change-detection. Reduced mismatch negativity response is one of the most replicated results in schizophrenia and has been suggested to be a superior psychosis marker. To understand whether this event-related potential component could be a similarly robust marker for Parkinson's psychosis, we used electroencephalography with a change-detection task to study the mismatch negativity in the visual modality in 20 participants with Parkinson's and visual hallucinations and 18 matched Parkinson's participants without hallucinations. We find that visual mismatch negativity is clearly present in participants with Parkinson's disease without hallucinations at both parieto-occipital and frontal sites, whereas participants with Parkinson's and visual hallucinations show reduced or no differences in the two waveforms, confirming the sensitivity of mismatch negativity to psychosis, even within the same diagnostic group. We also explored the relationship between hallucination severity and visual mismatch negativity amplitude, finding a negative correlation between visual hallucinations severity scores and visual mismatch negativity amplitude at a central frontal and a parieto-occipital electrodes, whereby the more severe or complex (illusions, formed visual hallucinations) the symptoms the smaller the amplitude. We have also tested the potential role of the serotonergic 5-HT2A cascade in visual hallucinations in Parkinson's with these symptoms, following the receptor trafficking hypothesis. We did so with a pilot study in healthy controls (N = 18) providing support for the role of the Gi/o-dependent pathway in the psychedelic effect and a case series in participants with Parkinson's and visual hallucinations (N = 5) using a double-blind crossover design. Positive results on psychosis scores and mismatch amplitude add further to the potential role of serotonergic modulation of visual hallucinations in Parkinson's disease.

When the interoceptive and conceptual clash: The case of oppositional phenomenal self-modelling in Tourette syndrome

Tourette syndrome (TS) has been associated with a rich set of symptoms that are said to be uncomfortable, unwilled, and effortful to manage. Furthermore, tics, the canonical characteristic of TS, are multifaceted, and their onset and maintenance is complex. A formal account that integrates these features of TS symptomatology within a plausible theoretical framework is currently absent from the field. In this paper, we assess the explanatory power of hierarchical generative modelling in accounting for TS symptomatology from the perspective of active inference. We propose a fourfold analysis of sensory, motor, and cognitive phenomena associated with TS. In Section 1, we characterise tics as a form of action aimed at sensory attenuation. In Section 2, we introduce the notion of epistemic ticcing and describe such behaviour as the search for evidence that there is an agent (i.e., self) at the heart of the generative hierarchy. In Section 3, we characterise both epistemic (sensation-free) and nonepistemic (sensational) tics as habitual behaviour. Finally, in Section 4, we propose that ticcing behaviour involves an inevitable conflict between distinguishable aspects of selfhood; namely, between the minimal phenomenal sense of self-which is putatively underwritten by interoceptive inference-and the explicit preferences that constitute the individual's conceptual sense of self. In sum, we aim to provide an empirically informed analysis of TS symptomatology under active inference, revealing a continuity between covert and overt features of the condition.

Understanding music and aging through the lens of Bayesian inference

Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.

Object-Centric Scene Representations Using Active Inference

Representing a scene and its constituent objects from raw sensory data is a core ability for enabling robots to interact with their environment. In this letter, we propose a novel approach for scene understanding, leveraging an object-centric generative model that enables an agent to infer object category and pose in an allocentric reference frame using active inference, a neuro-inspired framework for action and perception. For evaluating the behavior of an active vision agent, we also propose a new benchmark where, given a target viewpoint of a particular object, the agent needs to find the best matching viewpoint given a workspace with randomly positioned objects in 3D. We demonstrate that our active inference agent is able to balance epistemic foraging and goal-driven behavior, and quantitatively outperforms both supervised and reinforcement learning baselines by more than a factor of two in terms of success rate.

Digital Being: social media and the predictive mind

Social media is implicated today in an array of mental health concerns. While concerns around social media have become mainstream, little is known about the specific cognitive mechanisms underlying the correlations seen in these studies or why we find it so hard to stop engaging with these platforms when things obviously begin to deteriorate for us. New advances in computational neuroscience, however, are now poised to shed light on this matter. In this paper, we approach the phenomenon of social media addiction through the lens of the active inference framework. According to this framework, predictive agents like us use a 'generative model' of the world to predict our own incoming sense data and act to minimize any discrepancy between the prediction and incoming signal (prediction error). In order to live well and be able to act effectively to minimize prediction error, it is vital that agents like us have a generative model, which not only accurately reflects the regularities of our complex environment but is also flexible and dynamic and able to stay accurate in volatile and turbulent circumstances. In this paper, we propose that some social media platforms are a spectacularly effective way of warping an agent's generative model and of arresting the model's ability to flexibly track and adapt to changes in the environment. We go on to investigate cases of digital tech, which do not have these adverse effects and suggest-based on the active inference framework-some ways to understand why some forms of digital technology pose these risks, while others do not.

A model of time-varying music engagement

The current paper offers a model of time-varying music engagement, defined as changes in curiosity, attention and positive valence, as music unfolds over time. First, we present research (including new data) showing that listeners tend to allocate attention to music in a manner that is guided by both features of the music and listeners' individual differences. Next, we review relevant predictive processing literature before using this body of work to inform our model. In brief, we propose that music engagement, over the course of an extended listening episode, may constitute several cycles of curiosity, attention and positive valence that are interspersed with moments of mind-wandering. Further, we suggest that refocusing on music after an episode of mind-wandering can be due to triggers in the music or, conversely, mental action that occurs when the listener realizes they are mind-wandering. Finally, we argue that factors that modulate both overall levels of music engagement and how it changes over time include music complexity, listener background and the listening context. Our paper highlights how music can be used to provide insights into the temporal dynamics of attention and into how curiosity might emerge in everyday contexts. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Interoceptive technologies for psychiatric interventions: From diagnosis to clinical applications

Interoception-the perception of internal bodily signals-has emerged as an area of interest due to its implications in emotion and the prevalence of dysfunctional interoceptive processes across psychopathological conditions. Despite the importance of interoception in cognitive neuroscience and psychiatry, its experimental manipulation remains technically challenging. This is due to the invasive nature of existing methods, the limitation of self-report and unimodal measures of interoception, and the absence of standardized approaches across disparate fields. This article integrates diverse research efforts from psychology, physiology, psychiatry, and engineering to address this oversight. Following a general introduction to the neurophysiology of interoception as hierarchical predictive processing, we review the existing paradigms for manipulating interoception (e.g., interoceptive modulation), their underlying mechanisms (e.g., interoceptive conditioning), and clinical applications (e.g., interoceptive exposure). We suggest a classification for interoceptive technologies and discuss their potential for diagnosing and treating mental health disorders. Despite promising results, considerable work is still needed to develop standardized, validated measures of interoceptive function across domains and before these technologies can translate safely and effectively to clinical settings.

Path integrals, particular kinds, and strange things

This paper describes a path integral formulation of the free energy principle. The ensuing account expresses the paths or trajectories that a particle takes as it evolves over time. The main results are a method or principle of least action that can be used to emulate the behaviour of particles in open exchange with their external milieu. Particles are defined by a particular partition, in which internal states are individuated from external states by active and sensory blanket states. The variational principle at hand allows one to interpret internal dynamics-of certain kinds of particles-as inferring external states that are hidden behind blanket states. We consider different kinds of particles, and to what extent they can be imbued with an elementary form of inference or sentience. Specifically, we consider the distinction between dissipative and conservative particles, inert and active particles and, finally, ordinary and strange particles. Strange particles can be described as inferring their own actions, endowing them with apparent autonomy or agency. In short-of the kinds of particles afforded by a particular partition-strange kinds may be apt for describing sentient behaviour.

Understanding visual hallucinations: A new synthesis

Despite decades of research, we do not definitively know how people sometimes see things that are not there. Eight models of complex visual hallucinations have been published since 2000, including Deafferentation, Reality Monitoring, Perception and Attention Deficit, Activation, Input, and Modulation, Hodological, Attentional Networks, Active Inference, and Thalamocortical Dysrhythmia Default Mode Network Decoupling. Each was derived from different understandings of brain organisation. To reduce this variability, representatives from each research group agreed an integrated Visual Hallucination Framework that is consistent with current theories of veridical and hallucinatory vision. The Framework delineates cognitive systems relevant to hallucinations. It allows a systematic, consistent, investigation of relationships between the phenomenology of visual hallucinations and changes in underpinning cognitive structures. The episodic nature of hallucinations highlights separate factors associated with the onset, persistence, and end of specific hallucinations suggesting a complex relationship between state and trait markers of hallucination risk. In addition to a harmonised interpretation of existing evidence, the Framework highlights new avenues of research, and potentially, new approaches to treating distressing hallucinations.

Knee flexion of saxophone players anticipates tonal context of music

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze how knee flexion is employed by expert saxophone players. Using a computational model of the auditory periphery, we extracted emergent acoustical properties of sound to inference critical cognitive patterns of music processing and relate them to motion data. Results showed that knee flexion is causally linked to tone expectations and correlated to rhythmical density, suggesting that this gesture is associated with expressive and facilitative purposes. Furthermore, when instructed to play immobile, participants tended to microflex (>1 Hz) more frequently compared to when playing expressively, possibly indicating a natural urge to move to the music. These results underline the robustness of body movement in musical performance, providing valuable insights for the understanding of communicative processes, and development of motor learning cues.

Really radical?

I enjoyed reading this compelling account of Conviction Narrative Theory (CNT). As a theoretical neurobiologist, I recognised - and applauded - the tenets of CNT. My commentary asks whether its claims could be installed into a Bayesian mechanics of decision-making, in a way that would enable theoreticians to model, reproduce and predict decision-making.

A deep hierarchy of predictions enables online meaning extraction in a computational model of human speech comprehension

Understanding speech requires mapping fleeting and often ambiguous soundwaves to meaning. While humans are known to exploit their capacity to contextualize to facilitate this process, how internal knowledge is deployed online remains an open question. Here, we present a model that extracts multiple levels of information from continuous speech online. The model applies linguistic and nonlinguistic knowledge to speech processing, by periodically generating top-down predictions and incorporating bottom-up incoming evidence in a nested temporal hierarchy. We show that a nonlinguistic context level provides semantic predictions informed by sensory inputs, which are crucial for disambiguating among multiple meanings of the same word. The explicit knowledge hierarchy of the model enables a more holistic account of the neurophysiological responses to speech compared to using lexical predictions generated by a neural network language model (GPT-2). We also show that hierarchical predictions reduce peripheral processing via minimizing uncertainty and prediction error. With this proof-of-concept model, we demonstrate that the deployment of hierarchical predictions is a possible strategy for the brain to dynamically utilize structured knowledge and make sense of the speech input.

The Active Inference Model of Coherence Therapy

Coherence Therapy is an empirically derived experiential psychotherapy based on Psychological Constructivism. Symptoms are viewed as necessary output from an implicit model of the world. The therapist curates experiences and directs attention toward discovering the model. Rendered explicit, the model is juxtaposed with contradictory knowledge driving memory re-consolidation with resolution of the symptom. The Bayesian Brain views perception and action as inferential processes. Prior beliefs are combined in a generative model to explain the hidden causes of sensations through a process of Active Inference. Prior beliefs that are poor fits to the real world are suboptimal. Suboptimal priors with optimal inference produce Bayes Optimal Pathology with behavioral symptoms. The Active Inference Model of Coherence Therapy posits that Coherence Therapy is a dyadic act of therapist guided Active Inference that renders the (probable) hidden causes of a client's behavior conscious. The therapist's sustained attention on the goal of inference helps to overcome memory control bias against retrieval of the affectively charged suboptimal prior. Serial experiences cue memory retrieval and re-instantiation of the physiological/affective state that necessitates production of the symptom in a particular context. As this process continues there is a break in modularity with assimilation into broader networks of experience. Typically, the symptom produced by optimal inference with the suboptimal prior is experienced as unnecessary/inappropriate when taken out of the particular context. The implicit construct has been re-represented and rendered consciously accessible, by a more complex but more accurate model in which the symptom is necessary in some contexts but not others. There is an experience of agency and control in symptom creation, accompanied by the spontaneous production of context appropriate behavior. The capacity for inference has been restored. The Active Inference Model of Coherence Therapy provides a framework for Coherence Therapy as a computational process which can serve as the basis for new therapeutic interventions and experimental designs integrating biological, cognitive, behavioral, and environmental factors.

Computational psychiatry: from synapses to sentience

This review considers computational psychiatry from a particular viewpoint: namely, a commitment to explaining psychopathology in terms of pathophysiology. It rests on the notion of a generative model as underwriting (i) sentient processing in the brain, and (ii) the scientific process in psychiatry. The story starts with a view of the brain-from cognitive and computational neuroscience-as an organ of inference and prediction. This offers a formal description of neuronal message passing, distributed processing and belief propagation in neuronal networks; and how certain kinds of dysconnection lead to aberrant belief updating and false inference. The dysconnections in question can be read as a pernicious synaptopathy that fits comfortably with formal notions of how we-or our brains-encode uncertainty or its complement, precision. It then considers how the ensuing process theories are tested empirically, with an emphasis on the computational modelling of neuronal circuits and synaptic gain control that mediates attentional set, active inference, learning and planning. The opportunities afforded by this sort of modelling are considered in light of in silico experiments; namely, computational neuropsychology, computational phenotyping and the promises of a computational nosology for psychiatry. The resulting survey of computational approaches is not scholarly or exhaustive. Rather, its aim is to review a theoretical narrative that is emerging across subdisciplines within psychiatry and empirical scales of investigation. These range from epilepsy research to neurodegenerative disorders; from post-traumatic stress disorder to the management of chronic pain, from schizophrenia to functional medical symptoms.

How the Brain Becomes the Mind: Can Thermodynamics Explain the Emergence and Nature of Emotions?

The neural systems' electric activities are fundamental for the phenomenology of consciousness. Sensory perception triggers an information/energy exchange with the environment, but the brain's recurrent activations maintain a resting state with constant parameters. Therefore, perception forms a closed thermodynamic cycle. In physics, the Carnot engine is an ideal thermodynamic cycle that converts heat from a hot reservoir into work, or inversely, requires work to transfer heat from a low- to a high-temperature reservoir (the reversed Carnot cycle). We analyze the high entropy brain by the endothermic reversed Carnot cycle. Its irreversible activations provide temporal directionality for future orientation. A flexible transfer between neural states inspires openness and creativity. In contrast, the low entropy resting state parallels reversible activations, which impose past focus via repetitive thinking, remorse, and regret. The exothermic Carnot cycle degrades mental energy. Therefore, the brain's energy/information balance formulates motivation, sensed as position or negative emotions. Our work provides an analytical perspective of positive and negative emotions and spontaneous behavior from the free energy principle. Furthermore, electrical activities, thoughts, and beliefs lend themselves to a temporal organization, an orthogonal condition to physical systems. Here, we suggest that an experimental validation of the thermodynamic origin of emotions might inspire better treatment options for mental diseases.

Allostasis as a core feature of hierarchical gradients in the human brain

This paper integrates emerging evidence from two broad streams of scientific literature into one common framework: (a) hierarchical gradients of functional connectivity that reflect the brain's large-scale structural architecture (e.g., a lamination gradient in the cerebral cortex); and (b) approaches to predictive processing and one of its specific instantiations called allostasis (i.e., the predictive regulation of energetic resources in the service of coordinating the body's internal systems). This synthesis begins to sketch a coherent, neurobiologically inspired framework suggesting that predictive energy regulation is at the core of human brain function, and by extension, psychological and behavioral phenomena, providing a shared vocabulary for theory building and knowledge accumulation.

Machine learning and clinical neurophysiology

Clinical neurophysiology constructs a wealth of dynamic information pertaining to the integrity and function of both central and peripheral nervous systems. As with many technological fields, there has been an explosion of data in neurophysiology over recent years, and this requires considerable analysis by experts. Computational algorithms and especially advances in machine learning (ML) have the ability to assist with this task and potentially reveal hidden insights. In this update article, we will provide a brief overview where such technology is being applied in clinical neurophysiology and possible future directions.

Enhanced top-down sensorimotor processing in somatic anxiety

Functional neuroimaging research on anxiety has traditionally focused on brain networks associated with the psychological aspects of anxiety. Here, instead, we target the somatic aspects of anxiety. Motivated by the growing appreciation that top-down cortical processing plays a crucial role in perception and action, we used resting-state functional MRI data from the Human Connectome Project and Dynamic Causal Modeling (DCM) to characterize effective connectivity among hierarchically organized regions in the exteroceptive, interoceptive, and motor cortices. In people with high (fear-related) somatic arousal, top-down effective connectivity was enhanced in all three networks: an observation that corroborates well with the phenomenology of anxiety. The anxiety-associated changes in connectivity were sufficiently reliable to predict whether a new participant has mild or severe somatic anxiety. Interestingly, the increase in top-down connections to sensorimotor cortex were not associated with fear affect scores, thus establishing the (relative) dissociation between somatic and cognitive dimensions of anxiety. Overall, enhanced top-down effective connectivity in sensorimotor cortices emerges as a promising and quantifiable candidate marker of trait somatic anxiety.

Left and right temporal-parietal junctions (TPJs) as "match/mismatch" hedonic machines: A unifying account of TPJ function

Experimental and theoretical studies have tried to gain insights into the involvement of the Temporal Parietal Junction (TPJ) in a broad range of cognitive functions like memory, attention, language, self-agency and theory of mind. Recent investigations have demonstrated the partition of the TPJ in discrete subsectors. Nonetheless, whether these subsectors play different roles or implement an overarching function remains debated. Here, based on a review of available evidence, we propose that the left TPJ codes both matches and mismatches between expected and actual sensory, motor, or cognitive events while the right TPJ codes mismatches. These operations help keeping track of statistical contingencies in personal, environmental, and conceptual space. We show that this hypothesis can account for the participation of the TPJ in disparate cognitive functions, including "humour", and explain: a) the higher incidence of spatial neglect in right brain damage; b) the different emotional reactions that follow left and right brain damage; c) the hemispheric lateralisation of optimistic bias mechanisms; d) the lateralisation of mechanisms that regulate routine and novelty behaviours. We propose that match and mismatch operations are aimed at approximating "free energy", in terms of the free energy principle of decision-making. By approximating "free energy", the match/mismatch TPJ system supports both information seeking to update one's own beliefs and the pleasure of being right in one's own' current choices. This renewed view of the TPJ has relevant clinical implications because the misfunctioning of TPJ-related "match" and "mismatch" circuits in unilateral brain damage can produce low-dimensional deficits of active-inference and predictive coding that can be associated with different neuropsychological disorders.

Using network approaches to unravel the mysteries of visual hallucinations in Lewy body dementia

This scientific commentary refers to ‘Functional and structural brain network correlates of visual hallucinations in Lewy body dementia’ by Mehraram et al. (https://doi.org/10.1093/brain/awac094).

Augmenting Human Selves Through Artificial Agents – Lessons From the Brain

Much of current artificial intelligence (AI) and the drive toward artificial general intelligence (AGI) focuses on developing machines for functional tasks that humans accomplish. These may be narrowly specified tasks as in AI, or more general tasks as in AGI – but typically these tasks do not target higher-level human cognitive abilities, such as consciousness or morality; these are left to the realm of so-called “strong AI” or “artificial consciousness.” In this paper, we focus on how a machine can augment humans rather than do what they do, and we extend this beyond AGI-style tasks to augmenting peculiarly personal human capacities, such as wellbeing and morality. We base this proposal on associating such capacities with the “self,” which we define as the “environment-agent nexus”; namely, a fine-tuned interaction of brain with environment in all its relevant variables. We consider richly adaptive architectures that have the potential to implement this interaction by taking lessons from the brain. In particular, we suggest conjoining the free energy principle (FEP) with the dynamic temporo-spatial (TSD) view of neuro-mental processes. Our proposed integration of FEP and TSD – in the implementation of artificial agents – offers a novel, expressive, and explainable way for artificial agents to adapt to different environmental contexts. The targeted applications are broad: from adaptive intelligence augmenting agents (IA’s) that assist psychiatric self-regulation to environmental disaster prediction and personal assistants. This reflects the central role of the mind and moral decision-making in most of what we do as humans.

Measuring the prediction of observed actions using an occlusion paradigm: Comparing autistic and non-autistic adults

Action prediction involves observing and predicting the actions of others and plays an important role in social cognition and interacting with others. It is thought to use simulation, whereby the observers use their own motor system to predict the observed actions. As individuals diagnosed with autism are characterized by difficulties understanding the actions of others and motor coordination issues, it is possible that action prediction ability is altered in this population. This study compared action prediction ability between 20 autistic and 22 non-autistic adults using an occlusion paradigm. Participants watched different videos of a female actor carrying out everyday actions. During each video, the action was transiently occluded by a gray rectangle for 1000 ms. During occlusions, the video was allowed to continue as normal or was moved forward (i.e., appearing to continue too far ahead) or moved backwards (i.e., appearing to continue too far behind). Participants were asked to indicate after each occlusion whether the action continued with the correct timing or was too far ahead/behind. Autistic individuals were less accurate than non-autistic individuals, particularly when the video was too far behind. A trend analysis suggested that autistic participants were more likely to judge too far behind occlusions as being in time. These preliminary results suggest that prediction ability may be altered in autistic adults, potentially due to slower simulation or a delayed onset of these processes. LAY SUMMARY: When we observe other people performing everyday actions, we use their movements to help us understand and predict what they are doing. In this study, we found that autistic compared to non-autistic adults were slightly less accurate at predicting other people's actions. These findings help to unpick the different ways that social understanding is affected in autism.

Integrating Evolutionary, Cultural, and Computational Psychiatry: A Multilevel Systemic Approach

This paper proposes an integrative perspective on evolutionary, cultural and computational approaches to psychiatry. These three approaches attempt to frame mental disorders as multiscale entities and offer modes of explanations and modeling strategies that can inform clinical practice. Although each of these perspectives involves systemic thinking, each is limited in its ability to address the complex developmental trajectories and larger social systemic interactions that lead to mental disorders. Inspired by computational modeling in theoretical biology, this paper aims to integrate the modes of explanation offered by evolutionary, cultural and computational psychiatry in a multilevel systemic perspective. We apply the resulting Evolutionary, Cultural and Computational (ECC) model to Major Depressive Disorder (MDD) to illustrate how this integrative approach can guide research and practice in psychiatry.

The paradox of Prader-Willi syndrome revisited: Making sense of the phenotype

Prader-Willi syndrome arises as a consequence of absent paternal copies of maternally imprinted genes at 15q11-13. Such gender-of-origin imprinted genes are expressed in the brain and also in mammalian placenta where paternally expressed imprinted genes drive foetal nutritional demand. We hypothesise that the PWS phenotype is the result of the genotype impacting two pathways: first, directly on brain development and secondly, on placental nutritional pathways that results in its down-regulation and relative foetal starvation. The early PWS phenotype establishes the basis for the later characteristic phenotype. Hyperphagia. and other phenotypic characteristics arise as a consequence of impaired hypothalamic development. Hypothalamic feeding pathways become set in a state indicative of starvation, with a high satiety threshold and a dysfunctional neurophysiological state due to incorrect representations of reward needs, based on inputs that indicate a false requirement for food. Our hypotheses, if confirmed, would lead to novel and effective interventions.

Multi-dynamic modelling reveals strongly time-varying resting fMRI correlations

The activity of functional brain networks is responsible for the emergence of time-varying cognition and behaviour. Accordingly, time-varying correlations (Functional Connectivity) in resting fMRI have been shown to be predictive of behavioural traits, and psychiatric and neurological conditions. Typically, methods that measure time varying Functional Connectivity (FC), such as sliding windows approaches, do not separately model when changes occur in the mean activity levels from when changes occur in the FC, therefore conflating these two distinct types of modulation. We show that this can bias the estimation of time-varying FC to appear more stable over time than it actually is. Here, we propose an alternative approach that models changes in the mean brain activity and in the FC as being able to occur at different times to each other. We refer to this method as the Multi-dynamic Adversarial Generator Encoder (MAGE) model, which includes a model of the network dynamics that captures long-range time dependencies, and is estimated on fMRI data using principles of Generative Adversarial Networks. We evaluated the approach across several simulation studies and resting fMRI data from the Human Connectome Project (1003 subjects), as well as from UK Biobank (13301 subjects). Importantly, we find that separating fluctuations in the mean activity levels from those in the FC reveals much stronger changes in FC over time, and is a better predictor of individual behavioural variability.

The Free Energy Principle for Perception and Action: A Deep Learning Perspective

The free energy principle, and its corollary active inference, constitute a bio-inspired theory that assumes biological agents act to remain in a restricted set of preferred states of the world, i.e., they minimize their free energy. Under this principle, biological agents learn a generative model of the world and plan actions in the future that will maintain the agent in an homeostatic state that satisfies its preferences. This framework lends itself to being realized in silico, as it comprehends important aspects that make it computationally affordable, such as variational inference and amortized planning. In this work, we investigate the tool of deep learning to design and realize artificial agents based on active inference, presenting a deep-learning oriented presentation of the free energy principle, surveying works that are relevant in both machine learning and active inference areas, and discussing the design choices that are involved in the implementation process. This manuscript probes newer perspectives for the active inference framework, grounding its theoretical aspects into more pragmatic affairs, offering a practical guide to active inference newcomers and a starting point for deep learning practitioners that would like to investigate implementations of the free energy principle.

A mixed-modeling framework for whole-brain dynamic network analysis

The emerging area of dynamic brain network analysis has gained considerable attention in recent years. However, development of multivariate statistical frameworks that allow for examining the associations between phenotypic traits and dynamic patterns of system-level properties of the brain, and drawing statistical inference about such associations, has largely lagged behind. To address this need we developed a mixed-modeling framework that allows for assessing the relationship between any desired phenotype and dynamic patterns of whole-brain connectivity and topology. This novel framework also allows for simulating dynamic brain networks with respect to desired covariates. Unlike current tools, which largely use data-driven methods, our model-based method enables aligning neuroscientific hypotheses with the analytic approach. We demonstrate the utility of this model in identifying the relationship between fluid intelligence and dynamic brain networks by using resting-state fMRI (rfMRI) data from 200 participants in the Human Connectome Project (HCP) study. We also demonstrate the utility of this model to simulate dynamic brain networks at both group and individual levels. To our knowledge, this approach provides the first model-based statistical method for examining dynamic patterns of system-level properties of the brain and their relationships to phenotypic traits as well as simulating dynamic brain networks.

In recent years, a growing body of studies have aimed at analyzing the brain as a complex dynamic system by using various neuroimaging data. This has opened new avenues to answer compelling questions about the brain function in health and disease. However, methods that allow for providing statistical inference about how the complex interactions of the brain are associated with desired phenotypes are to be developed for a more profound insight. This study introduces a promising regression-based model to relate dynamic brain networks to desired phenotypes and provide statistical inference. Moreover, it can be used for simulating dynamic brain networks with respect to desired phenotypes at the group and individual levels.

Modeling the subjective perspective of consciousness and its role in the control of behaviours

Consciousness has been hypothesized to operate as a global workspace, which accesses and integrates multimodal information in a uni_ed manner, supports expectation violation monitoring and reduction, and the motivation, programming and control of action. One important yet open issue concerns how the subjective perspective at the core of consciousness, and subjective properties of manifestation of the environment in such perspective as an embodied experience, play a role in such process. We operationalised the concept of subjective perspective using the principles of the Projective Consciousness Model (PCM), based on the projective geometrical concept of Field of Consciousness. We show how these principles can account for documented relationships between appraisal and distance as an inverse distance law, yield a generative model of a_ective and epistemic drives based on purely subjective parameters, such as the apparent size of objects, and can be generalised to implement Theory of Mind, in a manner that is consistent with simulation theory. We used simulations of arti_cial agents, based on psychological rationale, to demonstrate how different model parameters could generate a variety of emergent adaptive and maladaptive behaviours that are relevant to developmental and clinical psychology: the ability to be resilient in the face of obstacles through imaginary projections, the emergence of social approach and joint attention behaviours, the ability to take advantage of false beliefs attributed to others, the emergence of avoidance behaviours as observed in social anxiety disorders, the presence of restricted interests as observed in autism spectrum disorders. The simulation of agents was applied to a speci_c robotic context, and agents' behaviours were demonstrated by controlling the corresponding robots. Our results contribute to advance the scienti_c understanding of the causal relationships between core aspects of the phenomenology of consciousness and its functions in human cybernetics.

Research on bilingualism as discovery science

An important aim of research on bilingualism is to understand how the brain adapts to the demands of using more than one language.In this paper, we argue that pursuing such an aim entails valuing our research as a discovery process that acts on variety.Prescriptions about sample size and methodology, rightly aimed at establishing a sound basis for generalization, should be understood as being in the service of science as a discovery process. We propose and illustrate by drawing from previous and contemporary examples within brain and cognitive sciences, that this necessitates exploring the neural bases of bilingual phenotypes:the adaptive variety induced through the interplay of biology and culture. We identify the conceptual and methodological prerequisites for such exploration and briefly allude to the publication practices that afford it as a community practice and to the risk of allowing methodological prescriptions, rather than discovery, to dominate the research endeavor.

Trust as Extended Control: Human-Machine Interactions as Active Inference

In order to interact seamlessly with robots, users must infer the causes of a robot's behavior-and be confident about that inference (and its predictions). Hence, trust is a necessary condition for human-robot collaboration (HRC). However, and despite its crucial role, it is still largely unknown how trust emerges, develops, and supports human relationship to technological systems. In the following paper we review the literature on trust, human-robot interaction, HRC, and human interaction at large. Early models of trust suggest that it is a trade-off between benevolence and competence; while studies of human to human interaction emphasize the role of shared behavior and mutual knowledge in the gradual building of trust. We go on to introduce a model of trust as an agent' best explanation for reliable sensory exchange with an extended motor plant or partner. This model is based on the cognitive neuroscience of active inference and suggests that, in the context of HRC, trust can be casted in terms of virtual control over an artificial agent. Interactive feedback is a necessary condition to the extension of the trustor's perception-action cycle. This model has important implications for understanding human-robot interaction and collaboration-as it allows the traditional determinants of human trust, such as the benevolence and competence attributed to the trustee, to be defined in terms of hierarchical active inference, while vulnerability can be described in terms of information exchange and empowerment. Furthermore, this model emphasizes the role of user feedback during HRC and suggests that boredom and surprise may be used in personalized interactions as markers for under and over-reliance on the system. The description of trust as a sense of virtual control offers a crucial step toward grounding human factors in cognitive neuroscience and improving the design of human-centered technology. Furthermore, we examine the role of shared behavior in the genesis of trust, especially in the context of dyadic collaboration, suggesting important consequences for the acceptability and design of human-robot collaborative systems.

Altered effective connectivity in sensorimotor cortices is a signature of severity and clinical course in depression

Research into neurobiology of depression primarily focuses on its complex psychological aspects. Here we propose an alternative approach and target sensorimotor alterations—a prominent but often neglected feature of depression. We demonstrated using resting-state functional MRI data and computational modeling that top-down and bottom-up information flow in sensory and motor cortices is altered with increasing depression severity in a way that is consistent with depression symptoms. Depression-associated changes were found to be consistent across sessions, amenable to treatment and of effect size sufficiently large to predict whether somebody has mild or severe depression. These results pave the way for an avenue of research into the neural underpinnings of mental health conditions.

Functional neuroimaging research on depression has traditionally targeted neural networks associated with the psychological aspects of depression. In this study, instead, we focus on alterations of sensorimotor function in depression. We used resting-state functional MRI data and dynamic causal modeling (DCM) to assess the hypothesis that depression is associated with aberrant effective connectivity within and between key regions in the sensorimotor hierarchy. Using hierarchical modeling of between-subject effects in DCM with parametric empirical Bayes we first established the architecture of effective connectivity in sensorimotor cortices. We found that in (interoceptive and exteroceptive) sensory cortices across participants, the backward connections are predominantly inhibitory, whereas the forward connections are mainly excitatory in nature. In motor cortices these parities were reversed. With increasing depression severity, these patterns are depreciated in exteroceptive and motor cortices and augmented in the interoceptive cortex, an observation that speaks to depressive symptomatology. We established the robustness of these results in a leave-one-out cross-validation analysis and by reproducing the main results in a follow-up dataset. Interestingly, with (nonpharmacological) treatment, depression-associated changes in backward and forward effective connectivity partially reverted to group mean levels. Overall, altered effective connectivity in sensorimotor cortices emerges as a promising and quantifiable candidate marker of depression severity and treatment response.

Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution

Predictive processing approaches to brain function are increasingly delivering promise for illuminating the computational underpinnings of a wide range of phenomenological states. It remains unclear, however, whether predictive processing is equipped to accommodate a theory of consciousness itself. Furthermore, objectors have argued that without specification of the core computational mechanisms of consciousness, predictive processing is unable to inform the attribution of consciousness to other non-human (biological and artificial) systems. In this paper, I argue that an account of consciousness in the predictive brain is within reach via recent accounts of phenomenal self-modelling in the active inference framework. The central claim here is that phenomenal consciousness is underpinned by 'subjective valuation'-a deep inference about the precision or 'predictability' of the self-evidencing ('fitness-promoting') outcomes of action. Based on this account, I argue that this approach can critically inform the distribution of experience in other systems, paying particular attention to the complex sensory attenuation mechanisms associated with deep self-models. I then consider an objection to the account: several recent papers argue that theories of consciousness that invoke self-consciousness as constitutive or necessary for consciousness are undermined by states (or traits) of 'selflessness'; in particular the 'totally selfless' states of ego-dissolution occasioned by psychedelic drugs. Drawing on existing work that accounts for psychedelic-induced ego-dissolution in the active inference framework, I argue that these states do not threaten to undermine an active inference theory of consciousness. Instead, these accounts corroborate the view that subjective valuation is the constitutive facet of experience, and they highlight the potential of psychedelic research to inform consciousness science, computational psychiatry and computational phenomenology.

A Predictive Processing Account of Card Sorting: Fast Proactive and Reactive Frontoparietal Cortical Dynamics during Inference and Learning of Perceptual Categories

For decades, a common assumption in cognitive neuroscience has been that prefrontal executive control is mainly engaged during target detection [Posner, M. I., & Petersen, S. E. The attention system of the human brain. Annual Review of Neuroscience, 13, 25-42, 1990]. More recently, predictive processing theories of frontal function under the Bayesian brain hypothesis emphasize a key role of proactive control for anticipatory action selection (i.e., planning as active inference). Here, we review evidence of fast and widespread EEG and magnetoencephalographic fronto-temporo-parietal cortical activations elicited by feedback cues and target cards in the Wisconsin Card Sorting Test. This evidence is best interpreted when considering negative and positive feedback as predictive cues (i.e., sensory outcomes) for proactively updating beliefs about unknown perceptual categories. Such predictive cues inform posterior beliefs about high-level hidden categories governing subsequent response selection at target onset. Quite remarkably, these new views concur with Don Stuss' early findings concerning two broad classes of P300 cortical responses evoked by feedback cues and target cards in a computerized Wisconsin Card Sorting Test analogue. Stuss' discussion of those P300 responses-in terms of the resolution of uncertainty about response (policy) selection as well as the participants' expectancies for future perceptual or motor activities and their timing-was prescient of current predictive processing and active (Bayesian) inference theories. From these new premises, a domain-general frontoparietal cortical network is rapidly engaged during two temporarily distinct stages of inference and learning of perceptual categories that underwrite goal-directed card sorting behavior, and they each engage prefrontal executive functions in fundamentally distinct ways.

The computational neurology of movement under active inference

We propose a computational neurology of movement based on the convergence of theoretical neurobiology and clinical neurology. A significant development in the former is the idea that we can frame brain function as a process of (active) inference, in which the nervous system makes predictions about its sensory data. These predictions depend upon an implicit predictive (generative) model used by the brain. This means neural dynamics can be framed as generating actions to ensure sensations are consistent with these predictions-and adjusting predictions when they are not. We illustrate the significance of this formulation for clinical neurology by simulating a clinical examination of the motor system using an upper limb coordination task. Specifically, we show how tendon reflexes emerge naturally under the right kind of generative model. Through simulated perturbations, pertaining to prior probabilities of this model's variables, we illustrate the emergence of hyperreflexia and pendular reflexes, reminiscent of neurological lesions in the corticospinal tract and cerebellum. We then turn to the computational lesions causing hypokinesia and deficits of coordination. This in silico lesion-deficit analysis provides an opportunity to revisit classic neurological dichotomies (e.g. pyramidal versus extrapyramidal systems) from the perspective of modern approaches to theoretical neurobiology-and our understanding of the neurocomputational architecture of movement control based on first principles.

Evidence and implications of abnormal predictive coding in dementia

The diversity of cognitive deficits and neuropathological processes associated with dementias has encouraged divergence in pathophysiological explanations of disease. Here, we review an alternative framework that emphasizes convergent critical features of cognitive pathophysiology. Rather than the loss of ‘memory centres’ or ‘language centres’, or singular neurotransmitter systems, cognitive deficits are interpreted in terms of aberrant predictive coding in hierarchical neural networks. This builds on advances in normative accounts of brain function, specifically the Bayesian integration of beliefs and sensory evidence in which hierarchical predictions and prediction errors underlie memory, perception, speech and behaviour. We describe how analogous impairments in predictive coding in parallel neurocognitive systems can generate diverse clinical phenomena, including the characteristics of dementias. The review presents evidence from behavioural and neurophysiological studies of perception, language, memory and decision-making. The reformulation of cognitive deficits in terms of predictive coding has several advantages. It brings diverse clinical phenomena into a common framework; it aligns cognitive and movement disorders; and it makes specific predictions on cognitive physiology that support translational and experimental medicine studies. The insights into complex human cognitive disorders from the predictive coding framework may therefore also inform future therapeutic strategies.

Quantitative skills in undergraduate neuroscience education in the age of big data

For over a half-Century, the mathematics requirement for graduation at most undergraduate colleges and universities has been one year of calculus and a semester of statistics. Many universities and colleges offer a neuroscience major that may or may not add additional mathematics, statistics, or data science requirements. Today in the age of Big Data and Systems Neuroscience, many students are ill-equipped for the future without the tools of computational competency that are necessary to tackle the large data sets generated by contemporary neuroscience research. Required courses in statistics still focus on parametric statistics based on the normal distribution and do not provide the computational tools required to analyze big data sets. Undergraduates in STEM fields including neuroscience need to enroll in the Data Science courses that are required in the social sciences (e.g., economics, political science and psychology). Contemporary systems neuroscience is routinely done by interdisciplinary research teams of statisticians, engineers, and physical scientists. Emerging "NeuroX-omics" such as connectomics have emerged along with genomics, proteomics, and transcriptomics, all of which deploy systems analysis techniques based on mathematical graph theory. Connectomics is the 21st Century's functional neuroanatomy. Whole brain connectome research appears almost monthly in the Drosphila, zebra fish, and mouse literature, and human brain connectomics is not far behind. The techniques for connectomics rely on the tools of data science. Undergraduate neuroscience students are already squeezed for credit hours given the high-prescribed science curriculum for biology majors and premedical students, in addition to required courses in social sciences and humanities. However, additional training in mathematics, statistics, computer science, and/or data science is urgently needed for undergraduate neuroscience majors just to understand the contemporary research literature. Undoubtedly, the faculty who teach neuroscience courses are acutely aware of the problem and most of them freely acknowledge the importance of quantitative analytical skills for their students. However, some faculty members may feel that their own math and statistics knowledge or other analytical skills have atrophied beyond recall or were never fulfilled in the first place. In this commentary I suggest that this problem can be ameliorated, though not solved, through organizing workshops, journal clubs, or independent studies courses in which the students and the instructors learn and teach each other in short-course format. In addition, web-available teaching materials such as targeted video clips are plentifully available on the internet. To attract and maintain student interest, qauntitative instruction and learning should occur in neuroscience context.

Computational models of the "active self" and its disturbances in schizophrenia

The notion that self-disorders are at the root of the emergence of schizophrenia rather than a symptom of the disease, is getting more traction in the cognitive sciences. This is in line with philosophical approaches that consider an enactive self, constituted through action and interaction with the environment. We thereby analyze different definitions of the self and evaluate various computational theories lending to these ideas. Bayesian and predictive processing are promising approaches for computational modeling of the "active self". We evaluate their implementation and challenges in computational psychiatry and cognitive developmental robotics. We describe how and why embodied robotic systems provide a valuable tool in psychiatry to assess, validate, and simulate mechanisms of self-disorders. Specifically, mechanisms involving sensorimotor learning, prediction, and self-other distinction, can be assessed with artificial agents. This link can provide essential insights to the formation of the self and new avenues in the treatment of psychiatric disorders.

Breakdown of Whole-brain Dynamics in Preterm-born Children

The brain operates at a critical point that is balanced between order and disorder. Even during rest, unstable periods of random behavior are interspersed with stable periods of balanced activity patterns that support optimal information processing. Being born preterm may cause deviations from this normal pattern of development. We compared 33 extremely preterm (EPT) children born at < 27 weeks of gestation and 28 full-term controls. Two approaches were adopted in both groups, when they were 10 years of age, using structural and functional brain magnetic resonance imaging data. The first was using a novel intrinsic ignition analysis to study the ability of the areas of the brain to propagate neural activity. The second was a whole-brain Hopf model, to define the level of stability, desynchronization, or criticality of the brain. EPT-born children exhibited fewer intrinsic ignition events than controls; nodes were related to less sophisticated aspects of cognitive control, and there was a different hierarchy pattern in the propagation of information and suboptimal synchronicity and criticality. The largest differences were found in brain nodes belonging to the rich-club architecture. These results provide important insights into the neural substrates underlying brain reorganization and neurodevelopmental impairments related to prematurity.

Deficits of hierarchical predictive coding in left spatial neglect

Right brain-damaged patients with unilateral spatial neglect fail to explore the left side of space. Recent EEG and clinical evidence suggests that neglect patients might suffer deficits in predictive coding, i.e. in identifying and exploiting probabilistic associations among sensory stimuli in the environment. To gain direct insights on this issue, we focussed on the hierarchical components of predictive coding. We recorded EEG responses evoked by central, left-side or right-side tones that were presented at the end of sequences of four central tones. Left-side and right-side deviant tones produce a pre-attentive Mismatch Negativity that reflects a lower-order prediction error for the 'Local' deviation of the tone at the end of the sequence. Higher-order prediction errors for the frequency of these deviations in the acoustic environment, i.e. 'Global' deviation, are marked by the P3 response. We show that when neglect patients are immersed in an acoustic environment characterized by frequent left-side deviant tones, they display no pre-attentive Mismatch Negativity both for left-side deviant tones and infrequent omissions of the last tone, while they have Mismatch Negativity for infrequent right-side deviant tones. In the same condition, neglect patients show no P300 response to 'Global' prediction errors for deviant tones, including those in the non-neglected right-side, and omissions. In contrast to this, when right-side deviant tones are predominant in the acoustic environment, neglect patients have pre-attentive Mismatch Negativity both for right-side deviant tones and infrequent omissions, while they display no Mismatch Negativity for infrequent left-side deviant tones. Most importantly, in the same condition neglect patients show enhanced P300 response to infrequent left-side deviant tones, notwithstanding that these tones evoked no pre-attentive Mismatch Negativity. This latter finding indicates that 'Global' predictions are independent of 'Local' error signals provided by the Mismatch Negativity. These results qualify deficits of predictive coding in the spatial neglect syndrome and show that neglect patients base their predictive behaviour only on statistical regularities that are related to the frequent occurrence of sensory events on the right side of space.

Why Depressed Mood is Adaptive: A Numerical Proof of Principle for an Evolutionary Systems Theory of Depression

We provide a proof of principle for an evolutionary systems theory (EST) of depression. This theory suggests that normative depressive symptoms counter socioenvironmental volatility by increasing interpersonal support via social signalling and that this response depends upon the encoding of uncertainty about social contingencies, which can be targeted by neuromodulatory antidepressants. We simulated agents that committed to a series of decisions in a social two-arm bandit task before and after social adversity, which precipitated depressive symptoms. Responses to social adversity were modelled under various combinations of social support and pharmacotherapy. The normative depressive phenotype responded positively to social support and simulated treatments with antidepressants. Attracting social support and administering antidepressants also alleviated anhedonia and social withdrawal, speaking to improvements in interpersonal relationships. These results support the EST of depression by demonstrating that following adversity, normative depressed mood preserved social inclusion with appropriate interpersonal support or pharmacotherapy.

Whatever Next and Close to My Self-The Transparent Senses and the "Second Skin": Implications for the Case of Depersonalization

In his paper “Whatever next? Predictive brains, situated agents, and the future of cognitive science,” Andy Clark seminally proposed that the brain's job is to predict whatever information is coming “next” on the basis of prior inputs and experiences. Perception fundamentally subserves survival and self-preservation in biological agents, such as humans. Survival however crucially depends on rapid and accurate information processing of what is happening in the here and now. Hence, the term “next” in Clark's seminal formulation must include not only the temporal dimension (i.e., what is perceived now) but also the spatial dimension (i.e., what is perceived here or next-to-my-body). In this paper, we propose to focus on perceptual experiences that happen “next,” i.e., close-to-my-body. This is because perceptual processing of proximal sensory inputs has a key impact on the organism's survival. Specifically, we focus on tactile experiences mediated by the skin and what we will call the “extended skin” or “second skin,” that is, immediate objects/materials that envelop closely to our skin, namely, clothes. We propose that the skin and tactile experiences are not a mere border separating the self and world. Rather, they simultaneously and inherently distinguish and connect the bodily self to its environment. Hence, these proximal and pervasive tactile experiences can be viewed as a “transparent bridge” intrinsically relating and facilitating exchanges between the self and the physical and social world. We conclude with potential implications of this observation for the case of Depersonalization Disorder, a condition that makes people feel estranged and detached from their self, body, and the world.

Simulating the computational mechanisms of cognitive and behavioral psychotherapeutic interventions: insights from active inference

Cognitive-behavioral therapy (CBT) leverages interactions between thoughts, feelings, and behaviors. To deepen understanding of these interactions, we present a computational (active inference) model of CBT that allows formal simulations of interactions between cognitive interventions (i.e., cognitive restructuring) and behavioral interventions (i.e., exposure) in producing adaptive behavior change (i.e., reducing maladaptive avoidance behavior). Using spider phobia as a concrete example of maladaptive avoidance more generally, we show simulations indicating that when conscious beliefs about safety/danger have strong interactions with affective/behavioral outcomes, behavioral change during exposure therapy is mediated by changes in these beliefs, preventing generalization. In contrast, when these interactions are weakened, and cognitive restructuring only induces belief uncertainty (as opposed to strong safety beliefs), behavior change leads to generalized learning (i.e., "over-writing" the implicit beliefs about action-outcome mappings that directly produce avoidance). The individual is therefore equipped to face any new context, safe or dangerous, remaining in a content state without the need for avoidance behavior-increasing resilience from a CBT perspective. These results show how the same changes in behavior during CBT can be due to distinct underlying mechanisms; they predict lower rates of relapse when cognitive interventions focus on inducing uncertainty and on reducing the effects of automatic negative thoughts on behavior.

Understanding the mental roots of social perceptions and behaviors: An integrated information-processing perspective

Crick and Dodge's (1994) social information processing (SIP) model asserts that SIP –the mental processes activated when humans encounter social situations and need to produce a response - is a strong predictor of social behavior. However, because SIP measurement is typically limited to conscious, explicit, and subjectively-reported responses, current SIP research may not capture the subtlety of this internal process, and critical components may remain obscured. Accordingly, the present essay takes an information processing perspective to propose ways to assess currently unattended levels of processing that could further our understanding of the mental mechanisms driving social information processing and consequent social behaviors. We focus on four levels of analysis that offer a thorough inspection of the ways by which social representations evolve. First, we discuss the interplay between implicit and explicit processes in SIP affecting social perceptions and behaviors. Second, we distinguish between perceptual and post-perceptual components of encoding and interpretation of social scenarios. Third, we discuss the evolvement of social representations over the course of processing. Finally, we look at the combined effect of prior knowledge and the actual sensory evidence in real-world situations. With terms and advanced methods borrowed from cognitive psychological research, this general perspective offers a more refined model of SIP that may better account for a wide range of social decision making and behaviors.

Representation Wars: Enacting an Armistice Through Active Inference

Over the last 30 years, representationalist and dynamicist positions in the philosophy of cognitive science have argued over whether neurocognitive processes should be viewed as representational or not. Major scientific and technological developments over the years have furnished both parties with ever more sophisticated conceptual weaponry. In recent years, an enactive generalization of predictive processing – known as active inference – has been proposed as a unifying theory of brain functions. Since then, active inference has fueled both representationalist and dynamicist campaigns. However, we believe that when diving into the formal details of active inference, one should be able to find a solution to the war; if not a peace treaty, surely an armistice of a sort. Based on an analysis of these formal details, this paper shows how both representationalist and dynamicist sensibilities can peacefully coexist within the new territory of active inference.

Modeling the Synchronization of Multimodal Perceptions as a Basis for the Emergence of Deterministic Behaviors

Living organisms have either innate or acquired mechanisms for reacting to percepts with an appropriate behavior e.g., by escaping from the source of a perception detected as threat, or conversely by approaching a target perceived as potential food. In the case of artifacts, such capabilities must be built in through either wired connections or software. The problem addressed here is to define a neural basis for such behaviors to be possibly learned by bio-inspired artifacts. Toward this end, a thought experiment involving an autonomous vehicle is first simulated as a random search. The stochastic decision tree that drives this behavior is then transformed into a plastic neuronal circuit. This leads the vehicle to adopt a deterministic behavior by learning and applying a causality rule just as a conscious human driver would do. From there, a principle of using synchronized multimodal perceptions in association with the Hebb principle of wiring together neuronal cells is induced. This overall framework is implemented as a virtual machine i.e., a concept widely used in software engineering. It is argued that such an interface situated at a meso-scale level between abstracted micro-circuits representing synaptic plasticity, on one hand, and that of the emergence of behaviors, on the other, allows for a strict delineation of successive levels of complexity. More specifically, isolating levels allows for simulating yet unknown processes of cognition independently of their underlying neurological grounding.

The Computational, Pharmacological, and Physiological Determinants of Sensory Learning under Uncertainty

The ability to represent and respond to uncertainty is fundamental to human cognition and decision-making. Noradrenaline (NA) is hypothesized to play a key role in coordinating the sensory, learning, and physiological states necessary to adapt to a changing world, but direct evidence for this is lacking in humans. Here, we tested the effects of attenuating noradrenergic neurotransmission on learning under uncertainty. We probed the effects of the β-adrenergic receptor antagonist propranolol (40 mg) using a between-subjects, double-blind, placebo-controlled design. Participants performed a probabilistic associative learning task, and we employed a hierarchical learning model to formally quantify prediction errors about cue-outcome contingencies and changes in these associations over time (volatility). Both unexpectedness and noise slowed down reaction times, but propranolol augmented the interaction between these main effects such that behavior was influenced more by prior expectations when uncertainty was high. Computationally, this was driven by a reduction in learning rates, with people slower to update their beliefs in the face of new information. Attenuating the global effects of NA also eliminated the phasic effects of prediction error and volatility on pupil size, consistent with slower belief updating. Finally, estimates of environmental volatility were predicted by baseline cardiac measures in all participants. Our results demonstrate that NA underpins behavioral and computational responses to uncertainty. These findings have important implications for understanding the impact of uncertainty on human biology and cognition.