Active inference, communication and hermeneutics

Instability and Uncertainty Are Critical for Psychotherapy: How the Therapeutic Alliance Opens Us Up

Tschacher and Haken have recently applied a systems-based approach to modeling psychotherapy process in terms of potentially beneficial tendencies toward deterministic as well as chaotic forms of change in the client's behavioral, cognitive and affective experience during the course of therapy. A chaotic change process refers to a greater exploration of the states that a client can be in, and it may have a potential positive role to play in their development. A distinction is made between on the one hand, specific instances of instability which are due to techniques employed by the therapist, and on the other, a more general instability which is due to the therapeutic relationship, and a key, necessary result of a successful therapeutic alliance. Drawing on Friston's systems-based model of free energy minimization and predictive coding, it is proposed here that the increase in the instability of a client's functioning due to therapy can be conceptualized as a reduction in the precisions (certainty) with which the client's prior beliefs about themselves and their world, are held. It is shown how a good therapeutic alliance (characterized by successful interpersonal synchrony of the sort described by Friston and Frith) results in the emergence of a new hierarchical level in the client's generative model of themselves and their relationship with the world. The emergence of this new level of functioning permits the reduction of the precisions of the client's priors, which allows the client to 'open up': to experience thoughts, emotions and experiences they did not have before. It is proposed that this process is a necessary precursor to change due to psychotherapy. A good consilience can be found between this approach to understanding the role of the therapeutic alliance, and the role of epistemic trust in psychotherapy as described by Fonagy and Allison. It is suggested that beneficial forms of instability in clients are an underappreciated influence on psychotherapy process, and thoughts about the implications, as well as situations in which instability may not be beneficial (or potentially harmful) for therapy, are considered.

What has social neuroscience learned from hyperscanning studies of spoken communication? A systematic review

A growing body of literature examining the neurocognitive processes of interpersonal linguistic interaction indicates the emergence of neural alignment as participants engage in oral communication. However, questions have arisen whether the study results can be interpreted beyond observations of cortical functionality and extended to the mutual understanding between communicators. This review presents evidence from electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) hyperscanning studies of interbrain synchrony (IBS) in which participants communicated via spoken language. The studies are classified into: knowledge sharing; turn-taking speech co-ordination; cooperation, problem-solving and creativity; and naturalistic discussion paradigms according to the type of interaction specified in each study. Alignment predominantly occurred in the frontal and temporo-parietal areas, which may reflect activation of the mirror and mentalizing systems. We argue that the literature presents a significant contribution to advancing our understanding of IBS and mutual understanding between communicators. We end with suggestions for future research, including analytical approaches and experimental conditions and hypothesize that brain-inspired neural networks are promising techniques for better understanding of IBS through hyperscanning.

Active inference leads to Bayesian neurophysiology

The neuronal substrates that implement the free-energy principle and ensuing active inference at the neuron and synapse level have not been fully elucidated. This Review considers possible neuronal substrates underlying the principle. First, the foundations of the free-energy principle are introduced, and then its ability to empirically explain various brain functions and psychological and biological phenomena in terms of Bayesian inference is described. Mathematically, the dynamics of neural activity and plasticity that minimise a cost function can be cast as performing Bayesian inference that minimises variational free energy. This equivalence licenses the adoption of the free-energy principle as a universal characterisation of neural networks. Further, the neural network structure itself represents a generative model under which an agent operates. A virtue of this perspective is that it enables the formal association of neural network properties with prior beliefs that regulate inference and learning. The possible neuronal substrates that implement prior beliefs and how to empirically examine the theory are discussed. This perspective renders brain activity explainable, leading to a deeper understanding of the neuronal mechanisms underlying basic psychology and psychiatric disorders in terms of an implicit generative model.

Permutation Entropy as a Universal Disorder Criterion: How Disorders at Different Scale Levels Are Manifestations of the Same Underlying Principle

What do bacteria, cells, organs, people, and social communities have in common? At first sight, perhaps not much. They involve totally different agents and scale levels of observation. On second thought, however, perhaps they share everything. A growing body of literature suggests that living systems at different scale levels of observation follow the same architectural principles and process information in similar ways. Moreover, such systems appear to respond in similar ways to rising levels of stress, especially when stress levels approach near-lethal levels. To explain such communalities, we argue that all organisms (including humans) can be modeled as hierarchical Bayesian controls systems that are governed by the same biophysical principles. Such systems show generic changes when taxed beyond their ability to correct for environmental disturbances. Without exception, stressed organisms show rising levels of 'disorder' (randomness, unpredictability) in internal message passing and overt behavior. We argue that such changes can be explained by a collapse of allostatic (high-level integrative) control, which normally synchronizes activity of the various components of a living system to produce order. The selective overload and cascading failure of highly connected (hub) nodes flattens hierarchical control, producing maladaptive behavior. Thus, we present a theory according to which organic concepts such as stress, a loss of control, disorder, disease, and death can be operationalized in biophysical terms that apply to all scale levels of organization. Given the presumed universality of this mechanism, 'losing control' appears to involve the same process anywhere, whether involving bacteria succumbing to an antibiotic agent, people suffering from physical or mental disorders, or social systems slipping into warfare. On a practical note, measures of disorder may serve as early warning signs of system failure even when catastrophic failure is still some distance away.

Osteopathy and Mental Health: An Embodied, Predictive, and Interoceptive Framework

Globally, mental and musculoskeletal disorders present with high prevalence, disease burden, and comorbidity. In order to improve the quality of care for patients with persistent physical and comorbid mental health conditions, person-centered care approaches addressing psychosocial factors are currently advocated. Central to successful person-centered care is a multidisciplinary collaboration between mental health and musculoskeletal specialists underpinned by a robust therapeutic alliance. Such a collaborative approach might be found in osteopathy, which is typically utilized to treat patients with musculoskeletal disorders but may arguably also benefit mental health outcomes. However, research and practice exploring the reputed effect of osteopathy on patients with mental health problems lack a robust framework. In this hypothesis and theory article, we build upon research from embodied cognition, predictive coding, interoception, and osteopathy to propose an embodied, predictive and interoceptive framework that underpins osteopathic person-centered care for individuals with persistent physical and comorbid mental health problems. Based on the premise that, for example, chronic pain and comorbid depression are underlined by overly precise predictions or imprecise sensory information, we hypothesize that osteopathic treatment may generate strong interoceptive prediction errors that update the generative model underpinning the experience of pain and depression. Thus, physical and mental symptoms may be reduced through active and perceptual inference. We discuss how these theoretical perspectives can inform future research into osteopathy and mental health to reduce the burden of comorbid psychological factors in patients with persistent physical symptoms and support person-centered multidisciplinary care in mental health.

Stochastic Chaos and Markov Blankets

In this treatment of random dynamical systems, we consider the existence-and identification-of conditional independencies at nonequilibrium steady-state. These independencies underwrite a particular partition of states, in which internal states are statistically secluded from external states by blanket states. The existence of such partitions has interesting implications for the information geometry of internal states. In brief, this geometry can be read as a physics of sentience, where internal states look as if they are inferring external states. However, the existence of such partitions-and the functional form of the underlying densities-have yet to be established. Here, using the Lorenz system as the basis of stochastic chaos, we leverage the Helmholtz decomposition-and polynomial expansions-to parameterise the steady-state density in terms of surprisal or self-information. We then show how Markov blankets can be identified-using the accompanying Hessian-to characterise the coupling between internal and external states in terms of a generalised synchrony or synchronisation of chaos. We conclude by suggesting that this kind of synchronisation may provide a mathematical basis for an elemental form of (autonomous or active) sentience in biology.

Memory and Markov Blankets

In theoretical biology, we are often interested in random dynamical systems-like the brain-that appear to model their environments. This can be formalized by appealing to the existence of a (possibly non-equilibrium) steady state, whose density preserves a conditional independence between a biological entity and its surroundings. From this perspective, the conditioning set, or Markov blanket, induces a form of vicarious synchrony between creature and world-as if one were modelling the other. However, this results in an apparent paradox. If all conditional dependencies between a system and its surroundings depend upon the blanket, how do we account for the mnemonic capacity of living systems? It might appear that any shared dependence upon past blanket states violates the independence condition, as the variables on either side of the blanket now share information not available from the current blanket state. This paper aims to resolve this paradox, and to demonstrate that conditional independence does not preclude memory. Our argument rests upon drawing a distinction between the dependencies implied by a steady state density, and the density dynamics of the system conditioned upon its configuration at a previous time. The interesting question then becomes: What determines the length of time required for a stochastic system to 'forget' its initial conditions? We explore this question for an example system, whose steady state density possesses a Markov blanket, through simple numerical analyses. We conclude with a discussion of the relevance for memory in cognitive systems like us.

Some Interesting Observations on the Free Energy Principle

Biehl et al. (2021) present some interesting observations on an early formulation of the free energy principle. We use these observations to scaffold a discussion of the technical arguments that underwrite the free energy principle. This discussion focuses on solenoidal coupling between various (subsets of) states in sparsely coupled systems that possess a Markov blanket-and the distinction between exact and approximate Bayesian inference, implied by the ensuing Bayesian mechanics.

The development of active binocular vision under normal and alternate rearing conditions

The development of binocular vision is an active learning process comprising the development of disparity tuned neurons in visual cortex and the establishment of precise vergence control of the eyes. We present a computational model for the learning and self-calibration of active binocular vision based on the Active Efficient Coding framework, an extension of classic efficient coding ideas to active perception. Under normal rearing conditions with naturalistic input, the model develops disparity tuned neurons and precise vergence control, allowing it to correctly interpret random dot stereograms. Under altered rearing conditions modeled after neurophysiological experiments, the model qualitatively reproduces key experimental findings on changes in binocularity and disparity tuning. Furthermore, the model makes testable predictions regarding how altered rearing conditions impede the learning of precise vergence control. Finally, the model predicts a surprising new effect that impaired vergence control affects the statistics of orientation tuning in visual cortical neurons.

Active Inference and Cooperative Communication: An Ecological Alternative to the Alignment View

We present and contrast two accounts of cooperative communication, both based on Active Inference, a framework that unifies biological and cognitive processes. The mental alignment account, defended in Vasil et al., takes the function of cooperative communication to be the alignment of the interlocutor's mental states, and cooperative communicative behavior to be driven by an evolutionarily selected adaptive prior belief favoring the selection of action policies that promote such an alignment. We argue that the mental alignment account should be rejected because it neglects the action-oriented nature of cooperative communication, which skews its view of the dynamics of communicative interaction. We introduce our own conception of cooperative communication, inspired by a more radical ecological interpretation of the active inference framework. Cooperative communication, on our ecological conception, serves to guide and constrain the dynamics of the cooperative interaction via the construction and restructuring of shared fields of affordances, in order to reach the local goals of the joint actions in which episodes of cooperative communication are embedded. We argue that our ecological conception provides a better theoretical standpoint to account for the action-oriented nature of cooperative communication in the active inference framework.

A hierarchical model for interpersonal verbal communication

The ability to use language makes us human. For decades, researchers have been racking their minds to understand the relation between language and the human brain. Nevertheless, most previous neuroscientific research has investigated this issue from a ‘single-brain’ perspective, thus neglecting the nature of interpersonal communication through language. With the development of modern hyperscanning techniques, researchers have begun probing the neurocognitive processes underlying interpersonal verbal communication and have examined the involvement of interpersonal neural synchronization (INS) in communication. However, in most cases, the neurocognitive processes underlying INS are obscure. To tentatively address this issue, we propose herein a hierarchical model based on the findings from a growing amount of hyperscanning research. We suggest that three levels of neurocognitive processes are primarily involved in interpersonal verbal communication and are closely associated with distinctive patterns of INS. Different levels of these processes modulate each other bidirectionally. Furthermore, we argued that two processes (shared representation and interpersonal predictive coding) might coexist and work together at each level to facilitate successful interpersonal verbal communication. We hope this model will inspire further innovative research in several directions within the fields of social and cognitive neuroscience.

An Active Inference Model of Collective Intelligence

Collective intelligence, an emergent phenomenon in which a composite system of multiple interacting agents performs at levels greater than the sum of its parts, has long compelled research efforts in social and behavioral sciences. To date, however, formal models of collective intelligence have lacked a plausible mathematical description of the relationship between local-scale interactions between autonomous sub-system components (individuals) and global-scale behavior of the composite system (the collective). In this paper we use the Active Inference Formulation (AIF), a framework for explaining the behavior of any non-equilibrium steady state system at any scale, to posit a minimal agent-based model that simulates the relationship between local individual-level interaction and collective intelligence. We explore the effects of providing baseline AIF agents (Model 1) with specific cognitive capabilities: Theory of Mind (Model 2), Goal Alignment (Model 3), and Theory of Mind with Goal Alignment (Model 4). These stepwise transitions in sophistication of cognitive ability are motivated by the types of advancements plausibly required for an AIF agent to persist and flourish in an environment populated by other highly autonomous AIF agents, and have also recently been shown to map naturally to canonical steps in human cognitive ability. Illustrative results show that stepwise cognitive transitions increase system performance by providing complementary mechanisms for alignment between agents’ local and global optima. Alignment emerges endogenously from the dynamics of interacting AIF agents themselves, rather than being imposed exogenously by incentives to agents’ behaviors (contra existing computational models of collective intelligence) or top-down priors for collective behavior (contra existing multiscale simulations of AIF). These results shed light on the types of generic information-theoretic patterns conducive to collective intelligence in human and other complex adaptive systems.

The Radically Embodied Conscious Cybernetic Bayesian Brain: From Free Energy to Free Will and Back Again

Drawing from both enactivist and cognitivist perspectives on mind, I propose that explaining teleological phenomena may require reappraising both "Cartesian theaters" and mental homunculi in terms of embodied self-models (ESMs), understood as body maps with agentic properties, functioning as predictive-memory systems and cybernetic controllers. Quasi-homuncular ESMs are suggested to constitute a major organizing principle for neural architectures due to their initial and ongoing significance for solutions to inference problems in cognitive (and affective) development. Embodied experiences provide foundational lessons in learning curriculums in which agents explore increasingly challenging problem spaces, so answering an unresolved question in Bayesian cognitive science: what are biologically plausible mechanisms for equipping learners with sufficiently powerful inductive biases to adequately constrain inference spaces? Drawing on models from neurophysiology, psychology, and developmental robotics, I describe how embodiment provides fundamental sources of empirical priors (as reliably learnable posterior expectations). If ESMs play this kind of foundational role in cognitive development, then bidirectional linkages will be found between all sensory modalities and frontal-parietal control hierarchies, so infusing all senses with somatic-motoric properties, thereby structuring all perception by relevant affordances, so solving frame problems for embodied agents. Drawing upon the Free Energy Principle and Active Inference framework, I describe a particular mechanism for intentional action selection via consciously imagined (and explicitly represented) goal realization, where contrasts between desired and present states influence ongoing policy selection via predictive coding mechanisms and backward-chained imaginings (as self-realizing predictions). This embodied developmental legacy suggests a mechanism by which imaginings can be intentionally shaped by (internalized) partially-expressed motor acts, so providing means of agentic control for attention, working memory, imagination, and behavior. I further describe the nature(s) of mental causation and self-control, and also provide an account of readiness potentials in Libet paradigms wherein conscious intentions shape causal streams leading to enaction. Finally, I provide neurophenomenological handlings of prototypical qualia including pleasure, pain, and desire in terms of self-annihilating free energy gradients via quasi-synesthetic interoceptive active inference. In brief, this manuscript is intended to illustrate how radically embodied minds may create foundations for intelligence (as capacity for learning and inference), consciousness (as somatically-grounded self-world modeling), and will (as deployment of predictive models for enacting valued goals).

From many to (n)one: Meditation and the plasticity of the predictive mind

How profoundly can humans change their own minds? In this paper we offer a unifying account of deconstructive meditation under the predictive processing view. We start from simple axioms. First, the brain makes predictions based on past experience, both phylogenetic and ontogenetic. Second, deconstructive meditation brings one closer to the here and now by disengaging anticipatory processes. We propose that practicing meditation therefore gradually reduces counterfactual temporally deep cognition, until all conceptual processing falls away, unveiling a state of pure awareness. Our account also places three main styles of meditation (focused attention, open monitoring, and non-dual) on a single continuum, where each technique relinquishes increasingly engrained habits of prediction, including the predicted self. This deconstruction can also permit certain insights by making the above processes available to introspection. Our framework is consistent with the state of empirical and (neuro)phenomenological evidence and illuminates the top-down plasticity of the predictive mind. Experimental rigor, neurophenomenology, and no-report paradigms are needed to further understanding of how meditation affects predictive processing and the self.

Immunoceptive inference: why are psychiatric disorders and immune responses intertwined?

There is a steadily growing literature on the role of the immune system in psychiatric disorders. So far, these advances have largely taken the form of correlations between specific aspects of inflammation (e.g. blood plasma levels of inflammatory markers, genetic mutations in immune pathways, viral or bacterial infection) with the development of neuropsychiatric conditions such as autism, bipolar disorder, schizophrenia and depression. A fundamental question remains open: why are psychiatric disorders and immune responses intertwined? To address this would require a step back from a historical mind-body dualism that has created such a dichotomy. We propose three contributions of active inference when addressing this question: translation, unification, and simulation. To illustrate these contributions, we consider the following questions. Is there an immunological analogue of sensory attenuation? Is there a common generative model that the brain and immune system jointly optimise? Can the immune response and psychiatric illness both be explained in terms of self-organising systems responding to threatening stimuli in their external environment, whether those stimuli happen to be pathogens, predators, or people? Does false inference at an immunological level alter the message passing at a psychological level (or vice versa) through a principled exchange between the two systems?

Reading between the lines: Listener's vmPFC simulates speaker cooperative choices in communication games

Humans have a remarkable ability to understand what is and is not being said by conversational partners. It has been hypothesized that listeners decode the intended meaning of a communicative signal by assuming speakers speak cooperatively, rationally simulating the speaker's choice process and inverting it to recover the speaker's most probable meaning. We investigated whether and how rational simulations of speakers are represented in the listener's brain, by combining referential communication games with functional neuroimaging. We show that listeners' ventromedial prefrontal cortex encodes the probabilistic inference of what a cooperative speaker should say given a communicative goal and context, even when such inferences are irrelevant for reference resolution. The listener's striatum encodes the amount of update on intended meaning, consistent with inverting a simulated mental model. These findings suggest a neural generative mechanism, subserved by the frontal-striatal circuits, that underlies our ability to understand communicative and, more generally, social actions.

How higher goals are constructed and collapse under stress: A hierarchical Bayesian control systems perspective

In this paper, we show that organisms can be modeled as hierarchical Bayesian control systems with small world and information bottleneck (bow-tie) network structure. Such systems combine hierarchical perception with hierarchical goal setting and hierarchical action control. We argue that hierarchical Bayesian control systems produce deep hierarchies of goal states, from which it follows that organisms must have some form of 'highest goals'. For all organisms, these involve internal (self) models, external (social) models and overarching (normative) models. We show that goal hierarchies tend to decompose in a top-down manner under severe and prolonged levels of stress. This produces behavior that favors short-term and self-referential goals over long term, social and/or normative goals. The collapse of goal hierarchies is universally accompanied by an increase in entropy (disorder) in control systems that can serve as an early warning sign for tipping points (disease or death of the organism). In humans, learning goal hierarchies corresponds to personality development (maturation). The failure of goal hierarchies to mature properly corresponds to personality deficits. A top-down collapse of such hierarchies under stress is identified as a common factor in all forms of episodic mental disorders (psychopathology). The paper concludes by discussing ways of testing these hypotheses empirically.

A Hybrid Human-Neurorobotics Approach to Primary Intersubjectivity via Active Inference

Interdisciplinary efforts from developmental psychology, phenomenology, and philosophy of mind, have studied the rudiments of social cognition and conceptualized distinct forms of intersubjective communication and interaction at human early life. Interaction theorists consider primary intersubjectivity a non-mentalist, pre-theoretical, non-conceptual sort of processes that ground a certain level of communication and understanding, and provide support to higher-level cognitive skills. We argue the study of human/neurorobot interaction consists in a unique opportunity to deepen understanding of underlying mechanisms in social cognition through synthetic modeling, while allowing to examine a second person experiential (2PP) access to intersubjectivity in embodied dyadic interaction. Concretely, we propose the study of primary intersubjectivity as a 2PP experience characterized by predictive engagement, where perception, cognition, and action are accounted for an hermeneutic circle in dyadic interaction. From our interpretation of the concept of active inference in free-energy principle theory, we propose an open-source methodology named neural robotics library (NRL) for experimental human/neurorobot interaction, wherein a demonstration program named virtual Cartesian robot (VCBot) provides an opportunity to experience the aforementioned embodied interaction to general audiences. Lastly, through a study case, we discuss some ways human-robot primary intersubjectivity can contribute to cognitive science research, such as to the fields of developmental psychology, educational technology, and cognitive rehabilitation.

Preferential Engagement and What Can We Learn from Online Chess?

An online game of chess against a human opponent appears to be indistinguishable from a game against a machine: both happen on the screen. Yet, people prefer to play chess against other people despite the fact that machines surpass people in skill. When the philosophers of 1970’s and 1980’s argued that computers will never surpass us in chess, perhaps their intuitions were rather saying “Computers will never be favored as opponents”? In this paper we analyse through the introduced concepts of psychological affordances and psychological interplay, what are the mechanisms that make a human-human (HH) interaction more meaningful than a human-computer (HC) interaction. We claim that an HH chess game consists of two intertwined, but independent simultaneous games—only one of which is retained in the HC game. To help with the analysis we introduce the thought experiment of a Preferential Engagement Test (PET) which is inspired by, but non-equivalent to, the Standard Turing Test. We also explore how the PET can illuminate, and be illuminated by, various philosophies of mind reading: Theory Theory, Simulation Theory and Mind Minding. We propose that our analysis along with the concept of PET could illuminate in a new way the conditions and challenges a machine (or its designers) must face before it can replace humans in a given occupation.

Learning Generative State Space Models for Active Inference

In this paper we investigate the active inference framework as a means to enable autonomous behavior in artificial agents. Active inference is a theoretical framework underpinning the way organisms act and observe in the real world. In active inference, agents act in order to minimize their so called free energy, or prediction error. Besides being biologically plausible, active inference has been shown to solve hard exploration problems in various simulated environments. However, these simulations typically require handcrafting a generative model for the agent. Therefore we propose to use recent advances in deep artificial neural networks to learn generative state space models from scratch, using only observation-action sequences. This way we are able to scale active inference to new and challenging problem domains, whilst still building on the theoretical backing of the free energy principle. We validate our approach on the mountain car problem to illustrate that our learnt models can indeed trade-off instrumental value and ambiguity. Furthermore, we show that generative models can also be learnt using high-dimensional pixel observations, both in the OpenAI Gym car racing environment and a real-world robotic navigation task. Finally we show that active inference based policies are an order of magnitude more sample efficient than Deep Q Networks on RL tasks.

Nonverbal auditory communication - Evidence for integrated neural systems for voice signal production and perception

While humans have developed a sophisticated and unique system of verbal auditory communication, they also share a more common and evolutionarily important nonverbal channel of voice signaling with many other mammalian and vertebrate species. This nonverbal communication is mediated and modulated by the acoustic properties of a voice signal, and is a powerful - yet often neglected - means of sending and perceiving socially relevant information. From the viewpoint of dyadic (involving a sender and a signal receiver) voice signal communication, we discuss the integrated neural dynamics in primate nonverbal voice signal production and perception. Most previous neurobiological models of voice communication modelled these neural dynamics from the limited perspective of either voice production or perception, largely disregarding the neural and cognitive commonalities of both functions. Taking a dyadic perspective on nonverbal communication, however, it turns out that the neural systems for voice production and perception are surprisingly similar. Based on the interdependence of both production and perception functions in communication, we first propose a re-grouping of the neural mechanisms of communication into auditory, limbic, and paramotor systems, with special consideration for a subsidiary basal-ganglia-centered system. Second, we propose that the similarity in the neural systems involved in voice signal production and perception is the result of the co-evolution of nonverbal voice production and perception systems promoted by their strong interdependence in dyadic interactions.

Generative models, linguistic communication and active inference

This paper presents a biologically plausible generative model and inference scheme that is capable of simulating communication between synthetic subjects who talk to each other. Building on active inference formulations of dyadic interactions, we simulate linguistic exchange to explore generative models that support dialogues. These models employ high-order interactions among abstract (discrete) states in deep (hierarchical) models. The sequential nature of language processing mandates generative models with a particular factorial structure-necessary to accommodate the rich combinatorics of language. We illustrate linguistic communication by simulating a synthetic subject who can play the 'Twenty Questions' game. In this game, synthetic subjects take the role of the questioner or answerer, using the same generative model. This simulation setup is used to illustrate some key architectural points and demonstrate that many behavioural and neurophysiological correlates of linguistic communication emerge under variational (marginal) message passing, given the right kind of generative model. For example, we show that theta-gamma coupling is an emergent property of belief updating, when listening to another.

An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement turbo coding via loopy message-passing over predictive (autoencoding) networks, thus generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, thus affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, thus enabling inferential synergy.

"Through others we become ourselves": The dialectics of predictive coding and active inference

Thinking through other minds creatively situates the free-energy principle within real-life cultural processes, thereby enriching both sociocultural theories and Bayesian accounts of cognition. Here, shifting the attention from thinking-through to becoming-with, we suggest complementing such an account by focusing on the empirical, computational, and conceptual investigation of the multiscale dynamics of social interaction.

Thinking through prior bodies: autonomic uncertainty and interoceptive self-inference

The Bayesian brain hypothesis, as formalized by the free-energy principle, is ascendant in cognitive science. But, how does the Bayesian brain obtain prior beliefs? Veissière and colleagues argue that sociocultural interaction is one important source. We offer a complementary model in which “interoceptive self-inference” guides the estimation of expected uncertainty both in ourselves and in our social conspecifics.

An Investigation of the Free Energy Principle for Emotion Recognition

This paper offers a prospectus of what might be achievable in the development of emotional recognition devices. It provides a conceptual overview of the free energy principle; including Markov blankets, active inference, and-in particular-a discussion of selfhood and theory of mind, followed by a brief explanation of how these concepts can explain both neural and cultural models of emotional inference. The underlying hypothesis is that emotion recognition and inference devices will evolve from state-of-the-art deep learning models into active inference schemes that go beyond marketing applications and become adjunct to psychiatric practice. Specifically, this paper proposes that a second wave of emotion recognition devices will be equipped with an emotional lexicon (or the ability to epistemically search for one), allowing the device to resolve uncertainty about emotional states by actively eliciting responses from the user and learning from these responses. Following this, a third wave of emotional devices will converge upon the user's generative model, resulting in the machine and human engaging in a reciprocal, prosocial emotional interaction, i.e., sharing a generative model of emotional states.

A World Unto Itself: Human Communication as Active Inference

Recent theoretical work in developmental psychology suggests that humans are predisposed to align their mental states with those of other individuals. One way this manifests is in cooperative communication; that is, intentional communication aimed at aligning individuals' mental states with respect to events in their shared environment. This idea has received strong empirical support. The purpose of this paper is to extend this account by proposing an integrative model of the biobehavioral dynamics of cooperative communication. Our formulation is based on active inference. Active inference suggests that action-perception cycles operate to minimize uncertainty and optimize an individual's internal model of the world. We propose that humans are characterized by an evolved adaptive prior belief that their mental states are aligned with, or similar to, those of conspecifics (i.e., that 'we are the same sort of creature, inhabiting the same sort of niche'). The use of cooperative communication emerges as the principal means to gather evidence for this belief, allowing for the development of a shared narrative that is used to disambiguate interactants' (hidden and inferred) mental states. Thus, by using cooperative communication, individuals effectively attune to a hermeneutic niche composed, in part, of others' mental states; and, reciprocally, attune the niche to their own ends via epistemic niche construction. This means that niche construction enables features of the niche to encode precise, reliable cues about the deontic or shared value of certain action policies (e.g., the utility of using communicative constructions to disambiguate mental states, given expectations about shared prior beliefs). In turn, the alignment of mental states (prior beliefs) enables the emergence of a novel, contextualizing scale of cultural dynamics that encompasses the actions and mental states of the ensemble of interactants and their shared environment. The dynamics of this contextualizing layer of cultural organization feedback, across scales, to constrain the variability of the prior expectations of the individuals who constitute it. Our theory additionally builds upon the active inference literature by introducing a new set of neurobiologically plausible computational hypotheses for cooperative communication. We conclude with directions for future research.

Variational ecology and the physics of sentient systems

This paper addresses the challenges faced by multiscale formulations of the variational (free energy) approach to dynamics that obtain for large-scale ensembles. We review a framework for modelling complex adaptive control systems for multiscale free energy bounding organism-niche dynamics, thereby integrating the modelling strategies and heuristics of variational neuroethology with a broader perspective on the ecological nestedness of biotic systems. We extend the multiscale variational formulation beyond the action-perception loops of individual organisms by appealing to the variational approach to niche construction to explain the dynamics of coupled systems constituted by organisms and their ecological niche. We suggest that the statistical robustness of living systems is inherited, in part, from their eco-niches, as niches help coordinate dynamical patterns across larger spatiotemporal scales. We call this approach variational ecology. We argue that, when applied to cultural animals such as humans, variational ecology enables us to formulate not just a physics of individual minds, but also a physics of interacting minds across spatial and temporal scales - a physics of sentient systems that range from cells to societies.

Fictional narrative as a variational Bayesian method for estimating social dispositions in large groups

Modelling intentions in large groups is cognitively costly. Not alone must first order beliefs be tracked ('what does A think about X?'), but also beliefs about beliefs ('what does A think about B's belief concerning X?'). Thus linear increases in group size impose non-linear increases in cognitive processing resources. At the same time, however, large groups offer coordination advantages relative to smaller groups due to specialisation and increased productive capacity. How might these competing demands be reconciled? We propose that fictional narrative can be understood as a cultural tool for dealing with large groups. Specifically, we argue that prototypical action roles that are removed from real-world interactions function as interpretive priors in a form of variational Bayesian inference, such that they allow estimations can be made of unknown social motives. We offer support for this claim in two ways. Firstly, by evaluating the existing literature on narrative cognition and showing where it anticipates a variational model; and secondly, by simulation, where we show that an agent-based model naturally converges on a set of social categories that resemble narrative across a wide range of starting points.

The hierarchically mechanistic mind: an evolutionary systems theory of the human brain, cognition, and behavior

The purpose of this review was to integrate leading paradigms in psychology and neuroscience with a theory of the embodied, situated human brain, called the Hierarchically Mechanistic Mind (HMM). The HMM describes the brain as a complex adaptive system that functions to minimize the entropy of our sensory and physical states via action-perception cycles generated by hierarchical neural dynamics. First, we review the extant literature on the hierarchical structure of the brain. Next, we derive the HMM from a broader evolutionary systems theory that explains neural structure and function in terms of dynamic interactions across four nested levels of biological causation (i.e., adaptation, phylogeny, ontogeny, and mechanism). We then describe how the HMM aligns with a global brain theory in neuroscience called the free-energy principle, leveraging this theory to mathematically formulate neural dynamics across hierarchical spatiotemporal scales. We conclude by exploring the implications of the HMM for psychological inquiry.

The Human Cost of Anthropogenic Global Warming: Semi-Quantitative Prediction and the 1,000-Tonne Rule

Greenhouse-gas emissions are indirectly causing future deaths by multiple mechanisms. For example, reduced food and water supplies will exacerbate hunger, disease, violence, and migration. How will anthropogenic global warming (AGW) affect global mortality due to poverty around and beyond 2100? Roughly, how much burned fossil carbon corresponds to one future death? What are the psychological, medical, political, and economic implications? Predicted death tolls are crucial for policy formulation, but uncertainty increases with temporal distance from the present and estimates may be biased. Order-of-magnitude estimates should refer to literature from diverse relevant disciplines. The carbon budget for 2°C AGW (roughly 1012 tonnes carbon) will indirectly cause roughly 109 future premature deaths (10% of projected maximum global population), spread over one to two centuries. This zeroth-order prediction is relative and in addition to existing preventable death rates. It lies between likely best- and worst-case scenarios of roughly 3 × 108 and 3 × 109, corresponding to plus/minus one standard deviation on a logarithmic scale in a Gaussian probability distribution. It implies that one future premature death is caused every time roughly 1,000 (300-3,000) tonnes of carbon are burned. Therefore, any fossil-fuel project that burns millions of tons of carbon is probably indirectly killing thousands of future people. The prediction may be considered valid, accounting for multiple indirect links between AGW and death rates in a top-down approach, but unreliable due to the uncertainty of climate change feedback and interactions between physical, biological, social, and political climate impacts (e.g., ecological cascade effects and co-extinction). Given universal agreement on the value of human lives, a death toll of this unprecedented magnitude must be avoided at all costs. As a clear political message, the "1,000-tonne rule" can be used to defend human rights, especially in developing countries, and to clarify that climate change is primarily a human rights issue.

Bayesian Filtering with Multiple Internal Models: Toward a Theory of Social Intelligence

To exhibit social intelligence, animals have to recognize whom they are communicating with. One way to make this inference is to select among internal generative models of each conspecific who may be encountered. However, these models also have to be learned via some form of Bayesian belief updating. This induces an interesting problem: When receiving sensory input generated by a particular conspecific, how does an animal know which internal model to update? We consider a theoretical and neurobiologically plausible solution that enables inference and learning of the processes that generate sensory inputs (e.g., listening and understanding) and reproduction of those inputs (e.g., talking or singing), under multiple generative models. This is based on recent advances in theoretical neurobiology-namely, active inference and post hoc (online) Bayesian model selection. In brief, this scheme fits sensory inputs under each generative model. Model parameters are then updated in proportion to the probability that each model could have generated the input (i.e., model evidence). The proposed scheme is demonstrated using a series of (real zebra finch) birdsongs, where each song is generated by several different birds. The scheme is implemented using physiologically plausible models of birdsong production. We show that generalized Bayesian filtering, combined with model selection, leads to successful learning across generative models, each possessing different parameters. These results highlight the utility of having multiple internal models when making inferences in social environments with multiple sources of sensory information.

Thinking through other minds: A variational approach to cognition and culture

The processes underwriting the acquisition of culture remain unclear. How are shared habits, norms, and expectations learned and maintained with precision and reliability across large-scale sociocultural ensembles? Is there a unifying account of the mechanisms involved in the acquisition of culture? Notions such as "shared expectations," the "selective patterning of attention and behaviour," "cultural evolution," "cultural inheritance," and "implicit learning" are the main candidates to underpin a unifying account of cognition and the acquisition of culture; however, their interactions require greater specification and clarification. In this article, we integrate these candidates using the variational (free-energy) approach to human cognition and culture in theoretical neuroscience. We describe the construction by humans of social niches that afford epistemic resources called cultural affordances. We argue that human agents learn the shared habits, norms, and expectations of their culture through immersive participation in patterned cultural practices that selectively pattern attention and behaviour. We call this process "thinking through other minds" (TTOM) - in effect, the process of inferring other agents' expectations about the world and how to behave in social context. We argue that for humans, information from and about other people's expectations constitutes the primary domain of statistical regularities that humans leverage to predict and organize behaviour. The integrative model we offer has implications that can advance theories of cognition, enculturation, adaptation, and psychopathology. Crucially, this formal (variational) treatment seeks to resolve key debates in current cognitive science, such as the distinction between internalist and externalist accounts of theory of mind abilities and the more fundamental distinction between dynamical and representational accounts of enactivism.

General Principles of Neurorobotic Models Employing Entrainment and Chaos Control

Neurorobotic models are perfect candidates for proving the validity of embodied/dynamical approaches to cognition. In order to control bodies of arbitrary complexity in complex environments, it is necessary to coordinate vast numbers of sensory and motor components. In this review, we took at several studies of neurorobotics and generalize common principles of how they achieve this massive feat, relying on the key concepts of entrainment and chaos control. We discuss current limitations and ways that these techniques could be expanded to cover more wide ranges of behavior, for example by taking inspiration from ecological psychology.

Age of Acquisition Effect: Evidence From Single-Word Reading and Neural Networks

Introduction:

Many studies show that words learned early in life are read more easily than the ones learned later and are less vulnerable to brain damage.

Methods:

the first part of the current study, 25 primary school students in the 5th grade read the word groups learned initially during a previous grade. The words used in the experiments were 327 Farsi monosyllable words matched on the other factors involved in Farsi word naming.

Results:

The analysis of covariance (the consistency and frequency as covariates) showed that words learned in earlier grades were read more easily than the ones learned later, showing the known effect of the Age of Acquisition (AoA). In the second part of the study, it was tried to simulate AoA in word naming by a neural network model developed earlier based on connectionist approach. While previous studies used random patterns, in the current study words from primary school books were used. Likewise, words learned early by the model were read better than words learned later. However, there was a failure in replicating previous simulation of AoA in English reading by an algorithm called Quick prop for Farsi. In addition, the model was lesioned by removing some hidden units to see its effect on word reading. As a result, words learned earlier were less vulnerable to damage compared with the ones learned later.

Conclusion:

The findings showed that words learned earlier, compared to those learned later, were read better and were less vulnerable to damage. These effects are explained by considering the nature of learning in neural networks trained by error back-propagation.

Regimes of Expectations: An Active Inference Model of Social Conformity and Human Decision Making

How do humans come to acquire shared expectations about how they ought to behave in distinct normalized social settings? This paper offers a normative framework to answer this question. We introduce the computational construct of 'deontic value' - based on active inference and Markov decision processes - to formalize conceptions of social conformity and human decision-making. Deontic value is an attribute of choices, behaviors, or action sequences that inherit directly from deontic cues in our econiche (e.g., red traffic lights); namely, cues that denote an obligatory social rule. Crucially, the prosocial aspect of deontic value rests upon a particular form of circular causality: deontic cues exist in the environment in virtue of the environment being modified by repeated actions, while action itself is contingent upon the deontic value of environmental cues. We argue that this construction of deontic cues enables the epistemic (i.e., information-seeking) and pragmatic (i.e., goal- seeking) values of any behavior to be 'cached' or 'outsourced' to the environment, where the environment effectively 'learns' about the behavior of its denizens. We describe the process whereby this particular aspect of value enables learning of habitual behavior over neurodevelopmental and transgenerational timescales.

Differential brain-to-brain entrainment while speaking and listening in native and foreign languages

The study explores interbrain neural coupling when interlocutors engage in a conversation whether it be in their native or nonnative language. To this end, electroencephalographic hyperscanning was used to study brain-to-brain phase synchronization during a two-person turn-taking verbal exchange with no visual contact, in either a native or a foreign language context. Results show that the coupling strength between brain signals is increased in both, the native language context and the foreign language context, specifically, in the alpha frequency band. A difference in brain-to speech entrainment to native and foreign languages is also shown. These results indicate that between brain similarities in the timing of neural activations and their spatial distributions change depending on the language code used. We argue that factors like linguistic alignment, joint attention and brain-entrainment to speech operate with a language-idiosyncratic neural configuration, modulating the alignment of neural activity between speakers and listeners. Other possible factors leading to the differential interbrain synchronization patterns as well as the potential features of brain-to-brain entrainment as a mechanism are briefly discussed. We concluded that linguistic context should be considered when addressing interpersonal communication. The findings here open doors to quantifying linguistic interactions.

Balancing Prediction and Sensory Input in Speech Comprehension: The Spatiotemporal Dynamics of Word Recognition in Context

Spoken word recognition in context is remarkably fast and accurate, with recognition times of ∼200 ms, typically well before the end of the word. The neurocomputational mechanisms underlying these contextual effects are still poorly understood. This study combines source-localized electroencephalographic and magnetoencephalographic (EMEG) measures of real-time brain activity with multivariate representational similarity analysis to determine directly the timing and computational content of the processes evoked as spoken words are heard in context, and to evaluate the respective roles of bottom-up and predictive processing mechanisms in the integration of sensory and contextual constraints. Male and female human participants heard simple (modifier-noun) English phrases that varied in the degree of semantic constraint that the modifier (W1) exerted on the noun (W2), as in pairs, such as "yellow banana." We used gating tasks to generate estimates of the probabilistic predictions generated by these constraints as well as measures of their interaction with the bottom-up perceptual input for W2. Representation similarity analysis models of these measures were tested against electroencephalographic and magnetoencephalographic brain data across a bilateral fronto-temporo-parietal language network. Consistent with probabilistic predictive processing accounts, we found early activation of semantic constraints in frontal cortex (LBA45) as W1 was heard. The effects of these constraints (at 100 ms after W2 onset in left middle temporal gyrus and at 140 ms in left Heschl's gyrus) were only detectable, however, after the initial phonemes of W2 had been heard. Within an overall predictive processing framework, bottom-up sensory inputs are still required to achieve early and robust spoken word recognition in context.SIGNIFICANCE STATEMENT Human listeners recognize spoken words in natural speech contexts with remarkable speed and accuracy, often identifying a word well before all of it has been heard. In this study, we investigate the brain systems that support this important capacity, using neuroimaging techniques that can track real-time brain activity during speech comprehension. This makes it possible to locate the brain areas that generate predictions about upcoming words and to show how these expectations are integrated with the evidence provided by the speech being heard. We use the timing and localization of these effects to provide the most specific account to date of how the brain achieves an optimal balance between prediction and sensory input in the interpretation of spoken language.

Predictive entrainment of natural speech through two fronto-motor top-down channels

Natural communication between interlocutors is enabled by the ability to predict upcoming speech in a given context. Previously we showed that these predictions rely on a fronto-motor top-down control of low-frequency oscillations in auditory-temporal brain areas that track intelligible speech. However, a comprehensive spatio-temporal characterisation of this effect is still missing. Here, we applied transfer entropy to source-localised MEG data during continuous speech perception. First, at low frequencies (1-4 Hz, brain delta phase to speech delta phase), predictive effects start in left fronto-motor regions and progress to right temporal regions. Second, at higher frequencies (14-18 Hz, brain beta power to speech delta phase), predictive patterns show a transition from left inferior frontal gyrus via left precentral gyrus to left primary auditory areas. Our results suggest a progression of prediction processes from higher-order to early sensory areas in at least two different frequency channels.

Perceptual facilitation of word recognition through motor activation during sentence comprehension

Despite the growing literature on anticipatory language processing, the brain dynamics of this high-level predictive process are still unclear. In the present MEG study, we analyzed pre- and post-stimulus oscillatory activity time-locked to the reading of a target word. We experimentally contrasted the processing of the same target word following two highly constraining sentence contexts, in which the constraint was driven either by the semantic content or by the lexical association between words. Previous research suggests the presence of sensory facilitation for expected words in the latter condition but not in the former. We observed a dissociation between beta (∼20 Hz) and gamma (>50 Hz) band activity in pre- and post-stimulus time intervals respectively. Both the beta and gamma effects were evident in occipital brain regions, and only the pre-stimulus beta effect additionally involved left pre-articulatory motor regions. Lexically constrained (vs. semantically constrained) words elicited reduced beta power around 400 msec before the target word in motor regions and a functionally related gamma enhancement in occipital regions around 200 msec post-target. The present findings highlight the role of the motor network in word-form prediction and support proposals claiming that low-level perceptual representations can be pre-activated during language prediction.

The Discrete and Continuous Brain: From Decisions to Movement-And Back Again

To act upon the world, creatures must change continuous variables such as muscle length or chemical concentration. In contrast, decision making is an inherently discrete process, involving the selection among alternative courses of action. In this article, we consider the interface between the discrete and continuous processes that translate our decisions into movement in a Newtonian world-and how movement informs our decisions. We do so by appealing to active inference, with a special focus on the oculomotor system. Within this exemplar system, we argue that the superior colliculus is well placed to act as a discrete-continuous interface. Interestingly, when the neuronal computations within the superior colliculus are formulated in terms of active inference, we find that many aspects of its neuroanatomy emerge from the computations it must perform in this role.

A Measure of Information Available for Inference

The mutual information between the state of a neural network and the state of the external world represents the amount of information stored in the neural network that is associated with the external world. In contrast, the surprise of the sensory input indicates the unpredictability of the current input. In other words, this is a measure of inference ability, and an upper bound of the surprise is known as the variational free energy. According to the free-energy principle (FEP), a neural network continuously minimizes the free energy to perceive the external world. For the survival of animals, inference ability is considered to be more important than simply memorized information. In this study, the free energy is shown to represent the gap between the amount of information stored in the neural network and that available for inference. This concept involves both the FEP and the infomax principle, and will be a useful measure for quantifying the amount of information available for inference.