Mind Causality: A Computational Neuroscience Approach

The connectivity of the human frontal pole cortex, and a theory of its involvement in exploit versus explore

The frontal pole is implicated in humans in whether to exploit resources versus explore alternatives. Effective connectivity, functional connectivity, and tractography were measured between six human frontal pole regions and for comparison 13 dorsolateral and dorsal prefrontal cortex regions, and the 360 cortical regions in the Human Connectome Project Multi-modal-parcellation atlas in 171 HCP participants. The frontal pole regions have effective connectivity with Dorsolateral Prefrontal Cortex regions, the Dorsal Prefrontal Cortex, both implicated in working memory; and with the orbitofrontal and anterior cingulate cortex reward/non-reward system. There is also connectivity with temporal lobe, inferior parietal, and posterior cingulate regions. Given this new connectivity evidence, and evidence from activations and damage, it is proposed that the frontal pole cortex contains autoassociation attractor networks that are normally stable in a short-term memory state, and maintain stability in the other prefrontal networks during stable exploitation of goals and strategies. However, if an input from the orbitofrontal or anterior cingulate cortex that expected reward, non-reward, or punishment is received, this destabilizes the frontal pole and thereby other prefrontal networks to enable exploration of competing alternative goals and strategies. The frontal pole connectivity with reward systems may be key in exploit versus explore.

Anatomy of the auditory cortex then and now

Using neuroanatomical investigations in the macaque, Deepak Pandya and his colleagues have established the framework for auditory cortex organization, with subdivisions into core and belt areas. This has aided subsequent neurophysiological and imaging studies in monkeys and humans, and a nomenclature building on Pandya's work has also been adopted by the Human Connectome Project. The foundational work by Pandya and his colleagues is highlighted here in the context of subsequent and ongoing studies on the functional anatomy and physiology of auditory cortex in primates, including humans, and their relevance for understanding cognitive aspects of speech and language.

Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala

The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.

Auditory cortical connectivity in humans

To understand auditory cortical processing, the effective connectivity between 15 auditory cortical regions and 360 cortical regions was measured in 171 Human Connectome Project participants, and complemented with functional connectivity and diffusion tractography. 1. A hierarchy of auditory cortical processing was identified from Core regions (including A1) to Belt regions LBelt, MBelt, and 52; then to PBelt; and then to HCP A4. 2. A4 has connectivity to anterior temporal lobe TA2, and to HCP A5, which connects to dorsal-bank superior temporal sulcus (STS) regions STGa, STSda, and STSdp. These STS regions also receive visual inputs about moving faces and objects, which are combined with auditory information to help implement multimodal object identification, such as who is speaking, and what is being said. Consistent with this being a "what" ventral auditory stream, these STS regions then have effective connectivity to TPOJ1, STV, PSL, TGv, TGd, and PGi, which are language-related semantic regions connecting to Broca's area, especially BA45. 3. A4 and A5 also have effective connectivity to MT and MST, which connect to superior parietal regions forming a dorsal auditory "where" stream involved in actions in space. Connections of PBelt, A4, and A5 with BA44 may form a language-related dorsal stream.

The human posterior cingulate, retrosplenial, and medial parietal cortex effective connectome, and implications for memory and navigation

The human posterior cingulate, retrosplenial, and medial parietal cortex are involved in memory and navigation. The functional anatomy underlying these cognitive functions was investigated by measuring the effective connectivity of these Posterior Cingulate Division (PCD) regions in the Human Connectome Project-MMP1 atlas in 171 HCP participants, and complemented with functional connectivity and diffusion tractography. First, the postero-ventral parts of the PCD (31pd, 31pv, 7m, d23ab, and v23ab) have effective connectivity with the temporal pole, inferior temporal visual cortex, cortex in the superior temporal sulcus implicated in auditory and semantic processing, with the reward-related vmPFC and pregenual anterior cingulate cortex, with the inferior parietal cortex, and with the hippocampal system. This connectivity implicates it in hippocampal episodic memory, providing routes for "what," reward and semantic schema-related information to access the hippocampus. Second, the antero-dorsal parts of the PCD (especially 31a and 23d, PCV, and also RSC) have connectivity with early visual cortical areas including those that represent spatial scenes, with the superior parietal cortex, with the pregenual anterior cingulate cortex, and with the hippocampal system. This connectivity implicates it in the "where" component for hippocampal episodic memory and for spatial navigation. The dorsal-transitional-visual (DVT) and ProStriate regions where the retrosplenial scene area is located have connectivity from early visual cortical areas to the parahippocampal scene area, providing a ventromedial route for spatial scene information to reach the hippocampus. These connectivities provide important routes for "what," reward, and "where" scene-related information for human hippocampal episodic memory and navigation. The midcingulate cortex provides a route from the anterior dorsal parts of the PCD and the supracallosal part of the anterior cingulate cortex to premotor regions.

Human amygdala compared to orbitofrontal cortex connectivity, and emotion

The amygdala and orbitofrontal cortex have been implicated in emotion. To understand these regions better in humans, their effective connectivity with 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography. The human amygdala has effective connectivity from few cortical regions compared to the orbitofrontal cortex: primarily from auditory cortex A5 and the related superior temporal gyrus and temporal pole regions; the piriform (olfactory) cortex; the lateral orbitofrontal cortex 47m; somatosensory cortex; the hippocampus, entorhinal cortex, perirhinal cortex, and parahippocampal TF; and from the cholinergic nucleus basalis. The amygdala has effective connectivity to the hippocampus, entorhinal and perirhinal cortex; to the temporal pole; and to the lateral orbitofrontal cortex. The orbitofrontal cortex has effective connectivity from gustatory, olfactory, and temporal visual, auditory and pole cortex, and to the pregenual anterior and posterior cingulate cortex, hippocampal system, and prefrontal cortex, and provides for rewards and punishers to be used in reported emotions, and memory and navigation to goals. Given the paucity of amygdalo-neocortical connectivity in humans, it is proposed that the human amygdala is involved primarily in autonomic and conditioned responses via brainstem connectivity, rather than in reported (declarative) emotion.

A Critical Perspective on the (Neuro)biological Foundations of Language and Linguistic Cognition

The biological foundations of language reflect assumptions about the way language and biology relate to one another, and with the rise of biological studies of language, we appear to have come closer to a deep understanding of linguistic cognition-the part of cognition constituted by language. This article argues that relations of neurobiological and genetic instantiation between linguistic cognition and the underlying biological substrate are ultimately irrelevant to understanding the higher-level structure and form of language. Linguistic patterns and those that make up the character of cognition constituted by language do not simply arise from the biological substrate because higher-level structures typically assume forms based on constraints that only emerge once these new levels are constructed. The goal is not to show how the mapping problem between linguistic cognition and neurobiology can be solved. Rather, the goal is to show the mapping problem ceases to exist once a different understanding of language-(neuro)biology relations is embraced. With this goal, this article first uncovers a number of logical and conceptual fallacies in strategies deployed in understanding language-(neuro)biology relations. After having shown these flaws, the article offers an alternative view of language-biology relations that shows how biological constraints shape language (nature and form), making it what it is.

Prefrontal and somatosensory-motor cortex effective connectivity in humans

Effective connectivity, functional connectivity, and tractography were measured between 57 cortical frontal and somatosensory regions and the 360 cortical regions in the Human Connectome Project (HCP) multimodal parcellation atlas for 171 HCP participants. A ventral somatosensory stream connects from 3b and 3a via 1 and 2 and then via opercular and frontal opercular regions to the insula, which then connects to inferior parietal PF regions. This stream is implicated in "what"-related somatosensory processing of objects and of the body and in combining with visual inputs in PF. A dorsal "action" somatosensory stream connects from 3b and 3a via 1 and 2 to parietal area 5 and then 7. Inferior prefrontal regions have connectivity with the inferior temporal visual cortex and orbitofrontal cortex, are implicated in working memory for "what" processing streams, and provide connectivity to language systems, including 44, 45, 47l, TPOJ1, and superior temporal visual area. The dorsolateral prefrontal cortex regions that include area 46 have connectivity with parietal area 7 and somatosensory inferior parietal regions and are implicated in working memory for actions and planning. The dorsal prefrontal regions, including 8Ad and 8Av, have connectivity with visual regions of the inferior parietal cortex, including PGs and PGi, and are implicated in visual and auditory top-down attention.

Multiple cortical visual streams in humans

The effective connectivity between 55 visual cortical regions and 360 cortical regions was measured in 171 HCP participants using the HCP-MMP atlas, and complemented with functional connectivity and diffusion tractography. A Ventrolateral Visual "What" Stream for object and face recognition projects hierarchically to the inferior temporal visual cortex, which projects to the orbitofrontal cortex for reward value and emotion, and to the hippocampal memory system. A Ventromedial Visual "Where" Stream for scene representations connects to the parahippocampal gyrus and hippocampus. An Inferior STS (superior temporal sulcus) cortex Semantic Stream receives from the Ventrolateral Visual Stream, from visual inferior parietal PGi, and from the ventromedial-prefrontal reward system and connects to language systems. A Dorsal Visual Stream connects via V2 and V3A to MT+ Complex regions (including MT and MST), which connect to intraparietal regions (including LIP, VIP and MIP) involved in visual motion and actions in space. It performs coordinate transforms for idiothetic update of Ventromedial Stream scene representations. A Superior STS cortex Semantic Stream receives visual inputs from the Inferior STS Visual Stream, PGi, and STV, and auditory inputs from A5, is activated by face expression, motion and vocalization, and is important in social behaviour, and connects to language systems.

Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures

Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.

The human language effective connectome

To advance understanding of brain networks involved in language, the effective connectivity between 26 cortical regions implicated in language by a community analysis and 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography, all using the HCP multimodal parcellation atlas. A (semantic) network (Group 1) involving inferior cortical regions of the superior temporal sulcus cortex (STS) with the adjacent inferior temporal visual cortex TE1a and temporal pole TG, and the connected parietal PGi region, has effective connectivity with inferior temporal visual cortex (TE) regions; with parietal PFm which also has visual connectivity; with posterior cingulate cortex memory-related regions; with the frontal pole, orbitofrontal cortex, and medial prefrontal cortex; with the dorsolateral prefrontal cortex; and with 44 and 45 for output regions. It is proposed that this system can build in its temporal lobe (STS and TG) and parietal parts (PGi and PGs) semantic representations of objects incorporating especially their visual and reward properties. Another (semantic) network (Group 3) involving superior regions of the superior temporal sulcus cortex and more superior temporal lobe regions including STGa, auditory A5, TPOJ1, the STV and the Peri-Sylvian Language area (PSL) has effective connectivity with auditory areas (A1, A4, A5, Pbelt); with relatively early visual areas involved in motion, e.g., MT and MST, and faces/words (FFC); with somatosensory regions (frontal opercular FOP, insula and parietal PF); with other TPOJ regions; and with the inferior frontal gyrus regions (IFJa and IFSp). It is proposed that this system builds semantic representations specialising in auditory and related facial motion information useful in theory of mind and somatosensory / body image information, with outputs directed not only to regions 44 and 45, but also to premotor 55b and midcingulate premotor cortex. Both semantic networks (Groups 1 and 3) have access to the hippocampal episodic memory system via parahippocampal TF. A third largely frontal network (Group 2) (44, 45, 47l; 55b; the Superior Frontal Language region SFL; and including temporal pole TGv) receives effective connectivity from the two semantic systems, and is implicated in syntax and speech output.

Inattentive Perception, Time, and the Incomprehensibility of Consciousness

Cerebral energy supply is insufficient to support continuous neuronal processing of the plethora of time-constant objects that we are aware of. As a result, the brain is forced to limit processing resources to (the most relevant) cases of change. The neuronally generated world is thus temporally discontinuous. This parallels the fact that, in all relevant microscopic fundamental equations of nature, temporal change plays a dominant role. When a scientist calculates a "solution" to such an equation, integration over time is an essential step. The present Hypothesis expresses that the step from neuronal activity to phenomenal content of consciousness is reflective of a (phenomenal) "solution:" the main source of the incomprehensibility of consciousness is proposed to result from the introduction of phenomenal time-constant entities. These are "filled-in" via integration, even though neuronal data only exists for changes to these entities. In this way, a temporally continuous picture of the world phenomenally appears. Qualia are "initial conditions," which are required for integration and cannot be deduced from present data. Phenomenal "identity" (vs. "high similarity") is related to qualia. Inattentive visual perception, which is only rarely investigated, offers insights into these relationships. Introspectively, unattended vision appears rich because percepts are cumulated over long time spans, whereas attentive perception relies purely on present neuronal signals. The present Hypothesis is that a brief neuronal activity can signify long-lasting and constant phenomenal content of consciousness. Experimental support is presented that comes from discrepancies between neuronal activity and perception: transient neuronal responses to sustained stimuli, "filling-in," change blindness, identity vs. close resemblance.