Computational principles of microcircuits for visual object processing in the macaque temporal cortex

The architecture of the human default mode network explored through cytoarchitecture, wiring and signal flow

The default mode network (DMN) is implicated in many aspects of complex thought and behavior. Here, we leverage postmortem histology and in vivo neuroimaging to characterize the anatomy of the DMN to better understand its role in information processing and cortical communication. Our results show that the DMN is cytoarchitecturally heterogenous, containing cytoarchitectural types that are variably specialized for unimodal, heteromodal and memory-related processing. Studying diffusion-based structural connectivity in combination with cytoarchitecture, we found the DMN contains regions receptive to input from sensory cortex and a core that is relatively insulated from environmental input. Finally, analysis of signal flow with effective connectivity models showed that the DMN is unique amongst cortical networks in balancing its output across the levels of sensory hierarchies. Together, our study establishes an anatomical foundation from which accounts of the broad role the DMN plays in human brain function and cognition can be developed.

Cortical Layer-Dependent Signaling in Cognition: Three Computational Modes of the Canonical Circuit

The cerebral cortex performs computations via numerous six-layer modules. The operational dynamics of these modules were studied primarily in early sensory cortices using bottom-up computation for response selectivity as a model, which has been recently revolutionized by genetic approaches in mice. However, cognitive processes such as recall and imagery require top-down generative computation. The question of whether the layered module operates similarly in top-down generative processing as in bottom-up sensory processing has become testable by advances in the layer identification of recorded neurons in behaving monkeys. This review examines recent advances in laminar signaling in these two computations, using predictive coding computation as a common reference, and shows that each of these computations recruits distinct laminar circuits, particularly in layer 5, depending on the cognitive demands. These findings highlight many open questions, including how different interareal feedback pathways, originating from and terminating at different layers, convey distinct functional signals.

Adaptation of the inferior temporal neurons and efficient visual processing

Numerous studies examining the responses of individual neurons in the inferior temporal (IT) cortex have revealed their characteristics such as two-dimensional or three-dimensional shape tuning, objects, or category selectivity. While these basic selectivities have been studied assuming that their response to stimuli is relatively stable, physiological experiments have revealed that the responsiveness of IT neurons also depends on visual experience. The activity changes of IT neurons occur over various time ranges; among these, repetition suppression (RS), in particular, is robustly observed in IT neurons without any behavioral or task constraints. I observed a similar phenomenon in the ventral visual neurons in macaque monkeys while they engaged in free viewing and actively fixated on one consistent object multiple times. This observation indicates that the phenomenon also occurs in natural situations during which the subject actively views stimuli without forced fixation, suggesting that this phenomenon is an everyday occurrence and widespread across regions of the visual system, making it a default process for visual neurons. Such short-term activity modulation may be a key to understanding the visual system; however, the circuit mechanism and the biological significance of RS remain unclear. Thus, in this review, I summarize the observed modulation types in IT neurons and the known properties of RS. Subsequently, I discuss adaptation in vision, including concepts such as efficient and predictive coding, as well as the relationship between adaptation and psychophysical aftereffects. Finally, I discuss some conceptual implications of this phenomenon as well as the circuit mechanisms and the models that may explain adaptation as a fundamental aspect of visual processing.

A neural modeling approach to study mechanisms underlying the heterogeneity of visual spatial frequency sensitivity in schizophrenia

Patients with schizophrenia exhibit abnormalities in spatial frequency sensitivity, and it is believed that these abnormalities indicate more widespread dysfunction and dysregulation of bottom-up processing. The early visual system, including the first-order Lateral Geniculate Nucleus of the thalamus (LGN) and the primary visual cortex (V1), are key contributors to spatial frequency sensitivity. Medicated and unmedicated patients with schizophrenia exhibit contrasting changes in spatial frequency sensitivity, thus making it a useful probe for examining potential effects of the disorder and antipsychotic medications in neural processing. We constructed a parameterized, rate-based neural model of on-center/off-surround neurons in the early visual system to investigate the impacts of changes to the excitatory and inhibitory receptive field subfields. By incorporating changes in both the excitatory and inhibitory subfields that are associated with pathophysiological findings in schizophrenia, the model successfully replicated perceptual data from behavioral/functional studies involving medicated and unmedicated patients. Among several plausible mechanisms, our results highlight the dampening of excitation and/or increase in the spread and strength of the inhibitory subfield in medicated patients and the contrasting decreased spread and strength of inhibition in unmedicated patients. Given that the model was successful at replicating results from perceptual data under a variety of conditions, these elements of the receptive field may be useful markers for the imbalances seen in patients with schizophrenia.

Multiscale chemogenetic dissection of fronto-temporal top-down regulation for object memory in primates

Visual object memory is a fundamental element of various cognitive abilities, and the underlying neural mechanisms have been extensively examined especially in the anterior temporal cortex of primates. However, both macroscopic large-scale functional network in which this region is embedded and microscopic neuron-level dynamics of top-down regulation it receives for object memory remains elusive. Here, we identified the orbitofrontal node as a critical partner of the anterior temporal node for object memory by combining whole-brain functional imaging during rest and a short-term object memory task in male macaques. Focal chemogenetic silencing of the identified orbitofrontal node downregulated both the local orbitofrontal and remote anterior temporal nodes during the task, in association with deteriorated mnemonic, but not perceptual, performance. Furthermore, imaging-guided neuronal recordings in the same monkeys during the same task causally revealed that orbitofrontal top-down modulation enhanced stimulus-selective mnemonic signal in individual anterior temporal neurons while leaving bottom-up perceptual signal unchanged. Furthermore, similar activity difference was also observed between correct and mnemonic error trials before silencing, suggesting its behavioral relevance. These multifaceted but convergent results provide a multiscale causal understanding of dynamic top-down regulation of the anterior temporal cortex along the ventral fronto-temporal network underpinning short-term object memory in primates.

A neural modeling approach to study mechanisms underlying the heterogeneity of visual spatial frequency sensitivity in schizophrenia

Patients with schizophrenia exhibit abnormalities in spatial frequency sensitivity, and it is believed that these abnormalities indicate more widespread dysfunction and dysregulation of bottom-up processing. The early visual system, including the first-order Lateral Geniculate Nucleus of the thalamus (LGN) and the primary visual cortex (V1), are key contributors to spatial frequency sensitivity. Medicated and unmedicated patients with schizophrenia exhibit contrasting changes in spatial frequency sensitivity, thus making it a useful probe for examining potential effects of the disorder and antipsychotic medications in neural processing. We constructed a parameterized, rate-based neural model of on-center/off-surround neurons in the early visual system to investigate the impacts of changes to the excitatory and inhibitory receptive field subfields. By incorporating changes in both the excitatory and inhibitory subfields that are associated with pathophysiological findings in schizophrenia, the model successfully replicated perceptual data from behavioral/functional studies involving medicated and unmedicated patients. Among several plausible mechanisms, our results highlight the dampening of excitation and/or increase in the spread and strength of the inhibitory subfield in medicated patients and the contrasting decreased spread and strength of inhibition in unmedicated patients. Given that the model was successful at replicating results from perceptual data under a variety of conditions, these elements of the receptive field may be useful markers for the imbalances seen in patients with schizophrenia.

Operating principles of the cerebral cortex as a six-layered network in primates: beyond the classic canonical circuit model

The cerebral cortex performs its computations with many six-layered fundamental units, collectively spreading along the cortical sheet. What is the local network structure and the operating dynamics of such a fundamental unit? Previous investigations of primary sensory areas revealed a classic "canonical" circuit model, leading to an expectation of similar circuit organization and dynamics throughout the cortex. This review clarifies the different circuit dynamics at play in the higher association cortex of primates that implements computation for high-level cognition such as memory and attention. Instead of feedforward processing of response selectivity through Layers 4 to 2/3 that the classic canonical circuit stipulates, memory recall in primates occurs in Layer 5/6 with local backward projection to Layer 2/3, after which the retrieved information is sent back from Layer 6 to lower-level cortical areas for further retrieval of nested associations of target attributes. In this review, a novel "dynamic multimode module (D3M)" in the primate association cortex is proposed, as a new "canonical" circuit model performing this operation.

Perirhinal circuits for memory processing

The perirhinal cortex (PRC) serves as the gateway to the hippocampus for episodic memory formation and plays a part in retrieval through its backward connectivity to various neocortical areas. First, I present the evidence suggesting that PRC neurons encode both experientially acquired object features and their associative relations. Recent studies have revealed circuit mechanisms in the PRC for the retrieval of cue-associated information, and have demonstrated that, in monkeys, PRC neuron-encoded information can be behaviourally read out. These studies, among others, support the theory that the PRC converts visual representations of an object into those of its associated features and initiates backward-propagating, interareal signalling for retrieval of nested associations of object features that, combined, extensionally represent the object meaning. I propose that the PRC works as the ventromedial hub of a 'two-hub model' at an apex of the hierarchy of a distributed memory network and integrates signals encoded in other downstream cortical areas that support diverse aspects of knowledge about an object.

Directed Interaction Between Monkey Premotor and Posterior Parietal Cortex During Motor-Goal Retrieval from Working Memory

Goal-directed behavior requires cognitive control of action, putatively by means of frontal-lobe impact on posterior brain areas. We investigated frontoparietal directed interaction (DI) in monkeys during memory-guided rule-based reaches, to test if DI supports motor-goal selection or working memory (WM) processes. We computed DI between the parietal reach region (PRR) and dorsal premotor cortex (PMd) with a Granger-causality measure of intracortical local field potentials (LFP). LFP mostly in the beta (12–32 Hz) and low-frequency (f≤10Hz) ranges contributed to DI. During movement withholding, beta-band activity in PRR had a Granger-causal effect on PMd independent of WM content. Complementary, low-frequency PMd activity had a transient Granger-causing effect on PRR specifically during WM retrieval of spatial motor goals, while no DI was associated with preliminary motor-goal selection. Our results support the idea that premotor and posterior parietal cortices interact functionally to achieve cognitive control during goal-directed behavior, in particular, that frontal-to-parietal interaction occurs during retrieval of motor-goal information from spatial WM.

A Novel Method for Training Mice in Visuo-Tactile 3-D Object Discrimination and Recognition

Perceiving, recognizing and remembering 3-dimensional (3-D) objects encountered in the environment has a very high survival value; unsurprisingly, this ability is shared among many animal species, including humans. The psychological, psychophysical and neural basis for object perception, discrimination, recognition and memory has been extensively studied in humans, monkeys, pigeons and rodents, but is still far from understood. Nearly all 3-D object recognition studies in the rodent used the "novel object recognition" paradigm, which relies on innate rather than learned behavior; however, this procedure has several important limitations. Recently, investigators have begun to recognize the power of behavioral tasks learned through reinforcement training (operant conditioning) to reveal the sensorimotor and cognitive abilities of mice and to elucidate their underlying neural mechanisms. Here, we describe a novel method for training and testing mice in visual and tactile object discrimination, recognition and memory, and use it to begin to examine the underlying sensory basis for these cognitive capacities. A custom-designed Y maze was used to train mice to associate one of two 3-D objects with a food reward. Out of nine mice trained in two cohorts, seven reached performance criterion in about 20-35 daily sessions of 20 trials each. The learned association was retained, or rapidly re-acquired, after a 6 weeks hiatus in training. When tested under low light conditions, individual animals differed in the degree to which they used tactile or visual cues to identify the objects. Switching to total darkness resulted only in a transient dip in performance, as did subsequent trimming of all large whiskers (macrovibrissae). Additional removal of the small whiskers (microvibrissae) did not degrade performance, but transiently increased the time spent inspecting the object. This novel method can be combined in future studies with the large arsenal of genetic tools available in the mouse, to elucidate the neural basis of object perception, recognition and memory.

Encoding of long-term associations through neural unitization in the human medial temporal lobe

Besides decades of research showing the role of the medial temporal lobe (MTL) in memory and the encoding of associations, the neural substrates underlying these functions remain unknown. We identified single neurons in the human MTL that responded to multiple and, in most cases, associated stimuli. We observed that most of these neurons exhibit no differences in their spike and local field potential (LFP) activity associated with the individual response-eliciting stimuli. In addition, LFP responses in the theta band preceded single neuron responses by ~70 ms, with the single trial phase providing fine tuning of the spike response onset. We postulate that the finding of similar neuronal responses to associated items provides a simple and flexible way of encoding memories in the human MTL, increasing the effective capacity for memory storage and successful retrieval.

In this work, the authors recorded single neurons and field potentials from the human medial temporal lobe (MTL) and show indistinguishable responses to associated stimuli. This coding mechanism provides a simple and flexible way of encoding memories in the human MTL.

Learning Recruits Neurons Representing Previously Established Associations in the Corvid Endbrain

Crows quickly learn arbitrary associations. As a neuronal correlate of this behavior, single neurons in the corvid endbrain area nidopallium caudolaterale (NCL) change their response properties during association learning. In crows performing a delayed association task that required them to map both familiar and novel sample pictures to the same two choice pictures, NCL neurons established a common, prospective code for associations. Here, we report that neuronal tuning changes during learning were not distributed equally in the recorded population of NCL neurons. Instead, such learning-related changes relied almost exclusively on neurons which were already encoding familiar associations. Only in such neurons did behavioral improvements during learning of novel associations coincide with increasing selectivity over the learning process. The size and direction of selectivity for familiar and newly learned associations were highly correlated. These increases in selectivity for novel associations occurred only late in the delay period. Moreover, NCL neurons discriminated correct from erroneous trial outcome based on feedback signals at the end of the trial, particularly in newly learned associations. Our results indicate that task-relevant changes during association learning are not distributed within the population of corvid NCL neurons but rather are restricted to a specific group of association-selective neurons. Such association neurons in the multimodal cognitive integration area NCL likely play an important role during highly flexible behavior in corvids.

The use of in vivo, ex vivo, in vitro, computational models and volunteer studies in vision research and therapy, and their contribution to the Three Rs

Much is known about mammalian vision, and considerable progress has been achieved in treating many vision disorders, especially those due to changes in the eye, by using various therapeutic methods, including stem cell and gene therapy. While cells and tissues from the main parts of the eye and the visual cortex (VC) can be maintained in culture, and many computer models exist, the current non-animal approaches are severely limiting in the study of visual perception and retinotopic imaging. Some of the early studies with cats and non-human primates (NHPs) are controversial for animal welfare reasons and are of questionable clinical relevance, particularly with respect to the treatment of amblyopia. More recently, the UK Home Office records have shown that attention is now more focused on rodents, especially the mouse. This is likely to be due to the perceived need for genetically-altered animals, rather than to knowledge of the similarities and differences of vision in cats, NHPs and rodents, and the fact that the same techniques can be used for all of the species. We discuss the advantages and limitations of animal and non-animal methods for vision research, and assess their relative contributions to basic knowledge and clinical practice, as well as outlining the opportunities they offer for implementing the principles of the Three Rs (Replacement, Reduction and Refinement).

Laminar Module Cascade from Layer 5 to 6 Implementing Cue-to-Target Conversion for Object Memory Retrieval in the Primate Temporal Cortex

The cerebral cortex computes through the canonical microcircuit that connects six stacked layers; however, how cortical processing streams operate in vivo, particularly in the higher association cortex, remains elusive. By developing a novel MRI-assisted procedure that reliably localizes recorded single neurons at resolution of six individual layers in monkey temporal cortex, we show that transformation of representations from a cued object to a to-be-recalled object occurs at the infragranular layer in a visual cued-recall task. This cue-to-target conversion started in layer 5 and was followed by layer 6. Finally, a subset of layer 6 neurons exclusively encoding the sought target became phase-locked to surrounding field potentials at theta frequency, suggesting that this coordinated cell assembly implements cortical long-distance outputs of the recalled target. Thus, this study proposes a link from local computation spanning laminar modules of the temporal cortex to the brain-wide network for memory retrieval in primates.

Associative learning rapidly establishes neuronal representations of upcoming behavioral choices in crows

The ability to form associations between behaviorally relevant sensory stimuli is fundamental for goal-directed behaviors. We investigated neuronal activity in the telencephalic area nidopallium caudolaterale (NCL) while two crows (Corvus corone) performed a delayed association task. Whereas some paired associates were familiar to the crows, novel associations had to be learned and mapped to the same target stimuli within a single session. We found neurons that prospectively encoded the chosen test item during the delay for both familiar and newly learned associations. These neurons increased their selectivity during learning in parallel with the crows' increased behavioral performance. Thus, sustained activity in the NCL actively processes information for the upcoming behavioral choice. These data provide new insights into memory representations of behaviorally meaningful stimuli in birds, and how such representations are formed during learning. The findings suggest that the NCL plays a role in learning arbitrary associations, a cornerstone of corvids' remarkable behavioral flexibility and adaptability.

Distributed encoding of spatial and object categories in primate hippocampal microcircuits

The primate hippocampus plays critical roles in the encoding, representation, categorization and retrieval of cognitive information. Such cognitive abilities may use the transformational input-output properties of hippocampal laminar microcircuitry to generate spatial representations and to categorize features of objects, images, and their numeric characteristics. Four nonhuman primates were trained in a delayed-match-to-sample (DMS) task while multi-neuron activity was simultaneously recorded from the CA1 and CA3 hippocampal cell fields. The results show differential encoding of spatial location and categorization of images presented as relevant stimuli in the task. Individual hippocampal cells encoded visual stimuli only on specific types of trials in which retention of either, the Sample image, or the spatial position of the Sample image indicated at the beginning of the trial, was required. Consistent with such encoding, it was shown that patterned microstimulation applied during Sample image presentation facilitated selection of either Sample image spatial locations or types of images, during the Match phase of the task. These findings support the existence of specific codes for spatial and numeric object representations in primate hippocampus which can be applied on differentially signaled trials. Moreover, the transformational properties of hippocampal microcircuitry, together with the patterned microstimulation are supporting the practical importance of this approach for cognitive enhancement and rehabilitation, needed for memory neuroprosthetics.

Preparing and selecting actions with neural populations: toward cortical circuit mechanisms

How the brain selects one action among multiple alternatives is a central question of neuroscience. An influential model is that action preparation and selection arise from subthreshold activation of the very neurons encoding the action. Recent work, however, shows a much greater diversity of decision-related and action-related signals coexisting with other signals in populations of motor and parietal cortical neurons. We discuss how such distributed signals might be decoded by biologically plausible mechanisms. We also discuss how neurons within cortical circuits might interact with each other during action selection and preparation and how recurrent network models can help to reveal dynamical principles underlying cortical computation.

Effects of Separate or Combined Neonatal Damage to the Orbital Frontal Cortex and the Inferior Convexity on Object Recognition in Monkeys

Unlike adult damage, neonatal damage to the inferior prefrontal convexity (IC) in monkeys spares learning and performance on the delayed nonmatching-to-sample (DNMS) task ( Málková et al. 2000). We investigated whether this sparing was due to compensation by undamaged orbital frontal cortex (O), an area also critical for DNMS, by comparing combined IC and O damage (Neo-ICO) with damage to O alone (Neo-O). Group Neo-ICO was impaired on DNMS learning at 3 months and 2 years of age. In contrast, Group Neo-O was impaired at 3 months, but recovered this function by 2 years, compared with Neo-IC and controls (N). We propose that the intact IC assumed the function of learning the DNMS rule for Group Neo-O. The persistent impairment after Neo-ICO lesions suggests that whereas O may likely support the rule acquisition in the absence of IC, no compensatory mechanisms are available after the combined damage. For the memory of lists of items, all groups were impaired at 3 months. At 2 years, the performance of Groups N and Neo-IC dramatically improved, whereas that of groups with O damage (Neo-O and Neo-ICO) remained impaired, indicating a critical role for O in recognition memory that cannot be substituted by another area.