Dynamic laminar rerouting of inter-areal mnemonic signal by cognitive operations in primate temporal cortex

Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans

Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. Recently, neural decoding schemes, such as machine learning in functional magnetic resonance imaging (fMRI), has been employed to elucidate the underlying neural mechanisms. However, it remains unclear as to how spatially distributed brain regions temporally represent visual object categories and sub-categories. One promising strategy to address this issue is neural decoding with concurrently obtained neural response data of high spatial and temporal resolution. In this study, we explored the spatial and temporal organization of visual object representations using concurrent fMRI and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). We hypothesized that neural decoding by multimodal neural data with DNN would show high classification performance in visual object categorization (faces or non-face objects) and sub-categorization within faces and objects. Visualization of the fMRI DNN was more sensitive than that in the univariate approach and revealed that visual categorization occurred in brain-wide regions. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization compared with fMRI DNN or EEG DNN alone. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner, and provide strong evidence of the ability of multimodal deep learning to uncover spatiotemporal neural machinery in sensory processing.

Operating principles of the cerebral cortex as a six-layered network in primates: beyond the classic canonical circuit model

The cerebral cortex performs its computations with many six-layered fundamental units, collectively spreading along the cortical sheet. What is the local network structure and the operating dynamics of such a fundamental unit? Previous investigations of primary sensory areas revealed a classic "canonical" circuit model, leading to an expectation of similar circuit organization and dynamics throughout the cortex. This review clarifies the different circuit dynamics at play in the higher association cortex of primates that implements computation for high-level cognition such as memory and attention. Instead of feedforward processing of response selectivity through Layers 4 to 2/3 that the classic canonical circuit stipulates, memory recall in primates occurs in Layer 5/6 with local backward projection to Layer 2/3, after which the retrieved information is sent back from Layer 6 to lower-level cortical areas for further retrieval of nested associations of target attributes. In this review, a novel "dynamic multimode module (D3M)" in the primate association cortex is proposed, as a new "canonical" circuit model performing this operation.

Parallel processing of working memory and temporal information by distinct types of cortical projection neurons

It is unclear how different types of cortical projection neurons work together to support diverse cortical functions. We examined the discharge characteristics and inactivation effects of intratelencephalic (IT) and pyramidal tract (PT) neurons-two major types of cortical excitatory neurons that project to cortical and subcortical structures, respectively-in the deep layer of the medial prefrontal cortex in mice performing a delayed response task. We found stronger target-dependent firing of IT than PT neurons during the delay period. We also found the inactivation of IT neurons, but not PT neurons, impairs behavioral performance. In contrast, PT neurons carry more temporal information than IT neurons during the delay period. Our results indicate a division of labor between IT and PT projection neurons in the prefrontal cortex for the maintenance of working memory and for tracking the passage of time, respectively.

Localization of movable electrodes in a multi-electrode microdrive in nonhuman primates

BACKGROUND

Recently, large-scale semi-chronic recording systems have been developed, unique in their capability to record simultaneously from multiple individually moveable electrodes. As these recording systems can cover a large area, knowledge of the exact location of each individual electrode is crucial. Currently, the only method of keeping track of electrode depth and thus location is through detailed notebook keeping on neural activity.

NEW METHOD

We have improved the electrode localization by combining pre- and postoperative anatomical magnetic resonance imaging (MRI) scans with high resolution computed tomography (CT) scans throughout the experiment, and validated our method by comparing the resulting location estimates with traditional notebook-keeping. Finally, the actual location of a selection of electrodes was marked at the end of the experiment by creating small metallic depositions using electrical stimulation, and thereby made visible on MRI.

RESULTS

Combining CT scans with a high resolution, artefact reducing sequence during the experiment with a preoperative MRI scan provides crucial information about the exact electrode location of multielectrode arrays with individually moveable electrodes.

COMPARISON WITH EXISTING METHODS

The information obtained from the hybrid CT-MR image and the notes on spiking activity showed a similar pattern, with the clear advantage of the visualization of the exact position of the electrodes using our method.

CONCLUSIONS

The described technique allows for a precise anatomical identification of the recorded brain areas and thus to draw strong conclusions about the role of each targeted cortical area in the behavior under study.