Maps in the brain: what can we learn from them?

Structured learning in time-dependent Cox models

Cox models with time-dependent coefficients and covariates are widely used in survival analysis. In high-dimensional settings, sparse regularization techniques are employed for variable selection, but existing methods for time-dependent Cox models lack flexibility in enforcing specific sparsity patterns (ie, covariate structures). We propose a flexible framework for variable selection in time-dependent Cox models, accommodating complex selection rules. Our method can adapt to arbitrary grouping structures, including interaction selection, temporal, spatial, tree, and directed acyclic graph structures. It achieves accurate estimation with low false alarm rates. We develop the sox package, implementing a network flow algorithm for efficiently solving models with complex covariate structures. sox offers a user-friendly interface for specifying grouping structures and delivers fast computation. Through examples, including a case study on identifying predictors of time to all-cause death in atrial fibrillation patients, we demonstrate the practical application of our method with specific selection rules.

Differential clustering of visual and choice- and saccade-related activity in macaque V3A and CIP

Neurons in sensory and motor cortices tend to aggregate in clusters with similar functional properties. Within the primate dorsal ("where") pathway, an important interface between three-dimensional (3-D) visual processing and motor-related functions consists of two hierarchically organized areas: V3A and the caudal intraparietal (CIP) area. In these areas, 3-D visual information, choice-related activity, and saccade-related activity converge, often at the single-neuron level. Characterizing the clustering of functional properties in areas with mixed selectivity, such as these, may help reveal organizational principles that support sensorimotor transformations. Here we quantified the clustering of visual feature selectivity, choice-related activity, and saccade-related activity by performing correlational and parametric comparisons of the responses of well-isolated, simultaneously recorded neurons in macaque monkeys. Each functional domain showed statistically significant clustering in both areas. However, there were also domain-specific differences in the strength of clustering across the areas. Visual feature selectivity and saccade-related activity were more strongly clustered in V3A than in CIP. In contrast, choice-related activity was more strongly clustered in CIP than in V3A. These differences in clustering may reflect the areas' roles in sensorimotor processing. Stronger clustering of visual and saccade-related activity in V3A may reflect a greater role in within-domain processing, as opposed to cross-domain synthesis. In contrast, stronger clustering of choice-related activity in CIP may reflect a greater role in synthesizing information across functional domains to bridge perception and action.NEW & NOTEWORTHY The occipital and parietal cortices of macaque monkeys are bridged by hierarchically organized areas V3A and CIP. These areas support 3-D visual transformations, carry choice-related activity during 3-D perceptual tasks, and possess saccade-related activity. This study quantifies the functional clustering of neuronal response properties within V3A and CIP for each of these domains. The findings reveal domain-specific cross-area differences in clustering that may reflect the areas' roles in sensorimotor processing.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Puckered and JNK signaling in pioneer neurons coordinates the motor activity of the Drosophila embryo

Central nervous system organogenesis is a complex process that obeys precise architectural rules. The impact that nervous system architecture may have on its functionality remains, however, relatively unexplored. To clarify this problem, we analyze the development of the Drosophila embryonic Ventral Nerve Cord (VNC). VNC morphogenesis requires the tight control of Jun kinase (JNK) signaling in a subset of pioneer neurons, exerted in part via a negative feedback loop mediated by the dual specificity phosphatase Puckered. Here we show that the JNK pathway autonomously regulates neuronal electrophysiological properties without affecting synaptic vesicle transport. Manipulating JNK signaling activity in pioneer neurons during early embryogenesis directly influences their function as organizers of VNC architecture and, moreover, uncovers a role in the coordination of the embryonic motor circuitry that is required for hatching. Together, our data reveal critical links, mediated by the control of the JNK signaling cascade by Puckered, between the structural organization of the VNC and its functional optimization.

A comprehensive neuroanatomical survey of the Drosophila Lobula Plate Tangential Neurons with predictions for their optic flow sensitivity

Flying insects exhibit remarkable navigational abilities controlled by their compact nervous systems. Optic flow, the pattern of changes in the visual scene induced by locomotion, is a crucial sensory cue for robust self-motion estimation, especially during rapid flight. Neurons that respond to specific, large-field optic flow patterns have been studied for decades, primarily in large flies, such as houseflies, blowflies, and hover flies. The best-known optic-flow sensitive neurons are the large tangential cells of the dipteran lobula plate, whose visual-motion responses, and to a lesser extent, their morphology, have been explored using single-neuron neurophysiology. Most of these studies have focused on the large, Horizontal and Vertical System neurons, yet the lobula plate houses a much larger set of 'optic-flow' sensitive neurons, many of which have been challenging to unambiguously identify or to reliably target for functional studies. Here we report the comprehensive reconstruction and identification of the Lobula Plate Tangential Neurons in an Electron Microscopy (EM) volume of a whole Drosophila brain. This catalog of 58 LPT neurons (per brain hemisphere) contains many neurons that are described here for the first time and provides a basis for systematic investigation of the circuitry linking self-motion to locomotion control. Leveraging computational anatomy methods, we estimated the visual motion receptive fields of these neurons and compared their tuning to the visual consequence of body rotations and translational movements. We also matched these neurons, in most cases on a one-for-one basis, to stochastically labeled cells in genetic driver lines, to the mirror-symmetric neurons in the same EM brain volume, and to neurons in an additional EM data set. Using cell matches across data sets, we analyzed the integration of optic flow patterns by neurons downstream of the LPTs and find that most central brain neurons establish sharper selectivity for global optic flow patterns than their input neurons. Furthermore, we found that self-motion information extracted from optic flow is processed in distinct regions of the central brain, pointing to diverse foci for the generation of visual behaviors.

Fast updating feedback from piriform cortex to the olfactory bulb relays multimodal reward contingency signals during rule-reversal

While animals readily adjust their behavior to adapt to relevant changes in the environment, the neural pathways enabling these changes remain largely unknown. Here, using multiphoton imaging, we investigated whether feedback from the piriform cortex to the olfactory bulb supports such behavioral flexibility. To this end, we engaged head-fixed mice in a multimodal rule-reversal task guided by olfactory and auditory cues. Both odor and, surprisingly, the sound cues triggered cortical bulbar feedback responses which preceded the behavioral report. Responses to the same sensory cue were strongly modulated upon changes in stimulus-reward contingency (rule reversals). The re-shaping of individual bouton responses occurred within seconds of the rule-reversal events and was correlated with changes in the behavior. Optogenetic perturbation of cortical feedback within the bulb disrupted the behavioral performance. Our results indicate that the piriform-to-olfactory bulb feedback carries reward contingency signals and is rapidly re-formatted according to changes in the behavioral context.

Signal processing in the vagus nerve: Hypotheses based on new genetic and anatomical evidence

Each organism must regulate its internal state in a metabolically efficient way as it interacts in space and time with an ever-changing and only partly predictable world. Success in this endeavor is largely determined by the ongoing communication between brain and body, and the vagus nerve is a crucial structure in that dialogue. In this review, we introduce the novel hypothesis that the afferent vagus nerve is engaged in signal processing rather than just signal relay. New genetic and structural evidence of vagal afferent fiber anatomy motivates two hypotheses: (1) that sensory signals informing on the physiological state of the body compute both spatial and temporal viscerosensory features as they ascend the vagus nerve, following patterns found in other sensory architectures, such as the visual and olfactory systems; and (2) that ascending and descending signals modulate one another, calling into question the strict segregation of sensory and motor signals, respectively. Finally, we discuss several implications of our two hypotheses for understanding the role of viscerosensory signal processing in predictive energy regulation (i.e., allostasis) as well as the role of metabolic signals in memory and in disorders of prediction (e.g., mood disorders).

Neuronal birthdate reveals topography in a vestibular brainstem circuit for gaze stabilization

Across the nervous system, neurons with similar attributes are topographically organized. This topography reflects developmental pressures. Oddly, vestibular (balance) nuclei are thought to be disorganized. By measuring activity in birthdated neurons, we revealed a functional map within the central vestibular projection nucleus that stabilizes gaze in the larval zebrafish. We first discovered that both somatic position and stimulus selectivity follow projection neuron birthdate. Next, with electron microscopy and loss-of-function assays, we found that patterns of peripheral innervation to projection neurons were similarly organized by birthdate. Finally, birthdate revealed spatial patterns of axonal arborization and synapse formation to projection neuron outputs. Collectively, we find that development reveals previously hidden organization to the input, processing, and output layers of a highly conserved vertebrate sensorimotor circuit. The spatial and temporal attributes we uncover constrain the developmental mechanisms that may specify the fate, function, and organization of vestibulo-ocular reflex neurons. More broadly, our data suggest that, like invertebrates, temporal mechanisms may assemble vertebrate sensorimotor architecture.

Understanding Human Object Vision: A Picture Is Worth a Thousand Representations

Objects are the core meaningful elements in our visual environment. Classic theories of object vision focus upon object recognition and are elegant and simple. Some of their proposals still stand, yet the simplicity is gone. Recent evolutions in behavioral paradigms, neuroscientific methods, and computational modeling have allowed vision scientists to uncover the complexity of the multidimensional representational space that underlies object vision. We review these findings and propose that the key to understanding this complexity is to relate object vision to the full repertoire of behavioral goals that underlie human behavior, running far beyond object recognition. There might be no such thing as core object recognition, and if it exists, then its importance is more limited than traditionally thought.

Nine insights from internet engineering that help us understand brain network communication

Philosophers have long recognized the value of metaphor as a tool that opens new avenues of investigation. By seeing brains as having the goal of representation, the computer metaphor in its various guises has helped systems neuroscience approach a wide array of neuronal behaviors at small and large scales. Here I advocate a complementary metaphor, the internet. Adopting this metaphor shifts our focus from computing to communication, and from seeing neuronal signals as localized representational elements to seeing neuronal signals as traveling messages. In doing so, we can take advantage of a comparison with the internet's robust and efficient routing strategies to understand how the brain might meet the challenges of network communication. I lay out nine engineering strategies that help the internet solve routing challenges similar to those faced by brain networks. The internet metaphor helps us by reframing neuronal activity across the brain as, in part, a manifestation of routing, which may, in different parts of the system, resemble the internet more, less, or not at all. I describe suggestive evidence consistent with the brain's use of internet-like routing strategies and conclude that, even if empirical data do not directly implicate internet-like routing, the metaphor is valuable as a reference point for those investigating the difficult problem of network communication in the brain and in particular the problem of routing.

Activity-dependent Organization of Topographic Neural Circuits

Sensory information in the brain is organized into spatial representations, including retinotopic, somatotopic, and tonotopic maps, as well as ocular dominance columns. The spatial representation of sensory inputs is thought to be a fundamental organizational principle that is important for information processing. Topographic maps are plastic throughout an animal's life, reflecting changes in development and aging of brain circuitry, changes in the periphery and sensory input, and changes in circuitry, for instance in response to experience and learning. Here, we review mechanisms underlying the role of activity in the development, stability and plasticity of topographic maps, focusing on recent work suggesting that the spatial information in the visual field, and the resulting spatiotemporal patterns of activity, provide instructive cues that organize visual projections.

High-throughput sequencing of single neuron projections reveals spatial organization in the olfactory cortex

In most sensory modalities, neuronal connectivity reflects behaviorally relevant stimulus features, such as spatial location, orientation, and sound frequency. By contrast, the prevailing view in the olfactory cortex, based on the reconstruction of dozens of neurons, is that connectivity is random. Here, we used high-throughput sequencing-based neuroanatomical techniques to analyze the projections of 5,309 mouse olfactory bulb and 30,433 piriform cortex output neurons at single-cell resolution. Surprisingly, statistical analysis of this much larger dataset revealed that the olfactory cortex connectivity is spatially structured. Single olfactory bulb neurons targeting a particular location along the anterior-posterior axis of piriform cortex also project to matched, functionally distinct, extra-piriform targets. Moreover, single neurons from the targeted piriform locus also project to the same matched extra-piriform targets, forming triadic circuit motifs. Thus, as in other sensory modalities, olfactory information is routed at early stages of processing to functionally diverse targets in a coordinated manner.

The global neuronal workspace as a broadcasting network

A new strategy for moving forward in the characterization of the global neuronal workspace (GNW) is proposed. According to Dehaene, Changeux, and colleagues (Dehaene, 2014, pp. 304, 312; Dehaene & Changeux, 2004, 2005), broadcasting is the main function of the GNW. However, the dynamic network properties described by recent graph theoretic GNW models are consistent with many large-scale communication processes that are different from broadcasting. We propose to apply a different graph theoretic approach, originally developed for optimizing information dissemination in communication networks, which can be used to identify the pattern of frequency and phase-specific directed functional connections that the GNW would exhibit only if it were a broadcasting network.

Orientation pinwheels in primary visual cortex of a highly visual marsupial

Primary visual cortices in many mammalian species exhibit modular and periodic orientation preference maps arranged in pinwheel-like layouts. The role of inherited traits as opposed to environmental influences in determining this organization remains unclear. Here, we characterize the cortical organization of an Australian marsupial, revealing pinwheel organization resembling that of eutherian carnivores and primates but distinctly different from the simpler salt-and-pepper arrangement of eutherian rodents and rabbits. The divergence of marsupials from eutherians 160 million years ago and the later emergence of rodents and rabbits suggest that the salt-and-pepper structure is not the primitive ancestral form. Rather, the genetic code that enables complex pinwheel formation is likely widespread, perhaps extending back to the common therian ancestors of modern mammals.

A brainstem map for visceral sensations

The nervous system uses various coding strategies to process sensory inputs. For example, the olfactory system uses large receptor repertoires and is wired to recognize diverse odours, whereas the visual system provides high acuity of object position, form and movement^1-5. Compared to external sensory systems, principles that underlie sensory processing by the interoceptive nervous system remain poorly defined. Here we developed a two-photon calcium imaging preparation to understand internal organ representations in the nucleus of the solitary tract (NTS), a sensory gateway in the brainstem that receives vagal and other inputs from the body. Focusing on gut and upper airway stimuli, we observed that individual NTS neurons are tuned to detect signals from particular organs and are topographically organized on the basis of body position. Moreover, some mechanosensory and chemosensory inputs from the same organ converge centrally. Sensory inputs engage specific NTS domains with defined locations, each containing heterogeneous cell types. Spatial representations of different organs are further sharpened in the NTS beyond what is achieved by vagal axon sorting alone, as blockade of brainstem inhibition broadens neural tuning and disorganizes visceral representations. These findings reveal basic organizational features used by the brain to process interoceptive inputs.

Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks

Language and social cognition, especially the ability to reason about mental states, known as theory of mind (ToM), are deeply related in development and everyday use. However, whether these cognitive faculties rely on distinct, overlapping, or the same mechanisms remains debated. Some evidence suggests that, by adulthood, language and ToM draw on largely distinct-though plausibly interacting-cortical networks. However, the broad topography of these networks is similar, and some have emphasized the importance of social content / communicative intent in the linguistic signal for eliciting responses in the language areas. Here, we combine the power of individual-subject functional localization with the naturalistic-cognition inter-subject correlation approach to illuminate the language-ToM relationship. Using functional magnetic resonance imaging (fMRI), we recorded neural activity as participants (n = 43) listened to stories and dialogues with mental state content (+linguistic, +ToM), viewed silent animations and live action films with mental state content but no language (-linguistic, +ToM), or listened to an expository text (+linguistic, -ToM). The ToM network robustly tracked stimuli rich in mental state information regardless of whether mental states were conveyed linguistically or non-linguistically, while tracking a +linguistic / -ToM stimulus only weakly. In contrast, the language network tracked linguistic stimuli more strongly than (a) non-linguistic stimuli, and than (b) the ToM network, and showed reliable tracking even for the linguistic condition devoid of mental state content. These findings suggest that in spite of their indisputably close links, language and ToM dissociate robustly in their neural substrates-and thus plausibly cognitive mechanisms-including during the processing of rich naturalistic materials.

The Influence of Neural Activity and Neural Cytoarchitecture on Cerebrovascular Arborization: A Computational Model

Normal functioning of the brain relies on a continual and efficient delivery of energy by a vast network of cerebral blood vessels. The bidirectional coupling between neurons and blood vessels consists of vasodilatory energy demand signals from neurons to blood vessels, and the retrograde flow of energy substrates from the vessels to neurons, which fuel neural firing, growth and other housekeeping activities in the neurons. Recent works indicate that, in addition to the functional coupling observed in the adult brain, the interdependence between the neural and vascular networks begins at the embryonic stage, and continues into subsequent developmental stages. The proposed Vascular Arborization Model (VAM) captures the effect of neural cytoarchitecture and neural activity on vascular arborization. The VAM describes three important stages of vascular tree growth: (i) The prenatal growth phase, where the vascular arborization depends on the cytoarchitecture of neurons and non-neural cells, (ii) the post-natal growth phase during which the further arborization of the vasculature depends on neural activity in addition to neural cytoarchitecture, and (iii) the settling phase, where the fully grown vascular tree repositions its vascular branch points or nodes to ensure minimum path length and wire length. The vasculature growth depicted by VAM captures structural characteristics like vascular volume density, radii, mean distance to proximal neurons in the cortex. VAM-grown vasculature agrees with the experimental observation that the neural densities do not covary with the vascular density along the depth of the cortex but predicts a high correlation between neural areal density and microvascular density when compared over a global scale (across animals and regions). To explore the influence of neural activity on vascular arborization, the VAM was used to grow the vasculature in neonatal rat whisker barrel cortex under two conditions: (i) Control, where the whiskers were intact and (ii) Lesioned, where one row of whiskers was cauterized. The model captures a significant reduction in vascular branch density in lesioned animals compared to control animals, concurring with experimental observation.

Analytic Model for Feature Maps in the Primary Visual Cortex

A compact analytic model is proposed to describe the combined orientation preference (OP) and ocular dominance (OD) features of simple cells and their mutual constraints on the spatial layout of the combined OP-OD map in the primary visual cortex (V1). This model consists of three parts: (i) an anisotropic Laplacian (AL) operator that represents the local neural sensitivity to the orientation of visual inputs; and (ii) obtain a receptive field (RF) operator that models the anisotropic spatial projection from nearby neurons to a given V1 cell over scales of a few tenths of a millimeter and combines with the AL operator to give an overall OP operator; and (iii) a map that describes how the parameters of these operators vary approximately periodically across V1. The parameters of the proposed model maximize the neural response at a given OP with an OP tuning curve fitted to experimental results. It is found that the anisotropy of the AL operator does not significantly affect OP selectivity, which is dominated by the RF anisotropy, consistent with Hubel and Wiesel's original conclusions that orientation tuning width of V1 simple cell is inversely related to the elongation of its RF. A simplified and idealized OP-OD map is then constructed to describe the approximately periodic local OP-OD structure of V1 in a compact form. It is shown explicitly that the OP map can be approximated by retaining its dominant spatial Fourier coefficients, which are shown to suffice to reconstruct its basic spatial structure. Moreover, this representation is a suitable form to analyze observed OP maps compactly and to be used in neural field theory (NFT) for analyzing activity modulated by the OP-OD structure of V1. Application to independently simulated V1 OP structure shows that observed irregularities in the map correspond to a spread of dominant coefficients in a circle in Fourier space. In addition, there is a strong bias toward two perpendicular directions when only a small patch of local map is included. The bias is decreased as the amount of V1 included in the Fourier transform is increased.

A sinusoidal transformation of the visual field is the basis for periodic maps in area V2

Retinotopic maps of many visual areas are thought to follow the fundamental principles described for the primary visual cortex (V1), where nearby points on the retina map to nearby points on the surface of V1, and orthogonal axes of the retinal surface are represented along orthogonal axes of the cortical surface. Here we demonstrate a striking departure from this mapping in the secondary visual area (V2) of the tree shrew best described as a sinusoidal transformation of the visual field. This sinusoidal topography is ideal for achieving uniform coverage in an elongated area like V2, as predicted by mathematical models designed for wiring minimization, and provides a novel explanation for periodic banded patterns of intra-cortical connections and functional response properties in V2 of tree shrews as well as several other species. Our findings suggest that cortical circuits flexibly implement solutions to sensory surface representation, with dramatic consequences for large-scale cortical organization.

Projections of the Mouse Primary Visual Cortex

Lesion or damage to the primary visual cortex (V1) results in a profound loss of visual perception in humans. Similarly, in mice, optogenetic silencing of V1 profoundly impairs discrimination of orientated gratings. V1 is thought to have such a critical role in perception in part due to its position in the visual processing hierarchy. It is the first brain area in the neocortex to receive visual input, and it distributes this information to more than 18 brain areas. Here I review recent advances in our understanding of the organization and function of the V1 projections in the mouse. This progress is in part due to new anatomical and viral techniques that allow for efficient labeling of projection neurons. In the final part of the review, I conclude by highlighting challenges and opportunities for future research.

Similarity of computations across domains does not imply shared implementation: The case of language comprehension

Understanding language requires applying cognitive operations (e.g., memory retrieval, prediction, structure building)-relevant across many cognitive domains-to specialized knowledge structures (a particular language's phonology, lexicon, and syntax). Are these computations carried out by domain-general circuits or by circuits that store domain-specific representations? Recent work has characterized the roles in language comprehension of the language-selective network and the multiple demand (MD) network, which has been implicated in executive functions and linked to fluid intelligence, making it a prime candidate for implementing computations that support information processing across domains. The language network responds robustly to diverse aspects of comprehension, but the MD network shows no sensitivity to linguistic variables. We therefore argue that the MD network does not play a core role in language comprehension, and that past claims to the contrary are likely due to methodological artifacts. Although future studies may discover some aspects of language that require the MD network, evidence to date suggests that those will not be related to core linguistic processes like lexical access or composition. The finding that the circuits that store linguistic knowledge carry out computations on those representations aligns with general arguments against the separation between memory and computation in the mind and brain.

Punctuated evolution of visual cortical circuits? Evidence from the large rodent Dasyprocta leporina, and the tiny primate Microcebus murinus

Recent reports of the lack of periodic orientation columns in a very large rodent species, the red-rumped agouti, and the existence of incompressible hypercolumns in the lineage of primates, as demonstrated in one of the smallest primates, the mouse lemur, strengthen the interpretation that salt-and-pepper and columns-and-pinwheel mosaics are two distinct functional layouts. These layouts do neither depend on lifestyle nor scale with body size, brain size, absolute neuron numbers, binocular overlap, or visual acuity, but are primarily distinguishable by phylogenetic traits. The predictive value of other biological signatures such as V1 neuronal surface density and the central-peripheral density ratio of retinal ganglion cells are reconsidered, and experiments elucidating the intracortical connectivity in rodents are proposed.

Visuospatial coding as ubiquitous scaffolding for human cognition

For more than 100 years we have known that the visual field is mapped onto the surface of visual cortex, imposing an inherently spatial reference frame on visual information processing. Recent studies highlight visuospatial coding not only throughout visual cortex, but also brain areas not typically considered visual. Such widespread access to visuospatial coding raises important questions about its role in wider cognitive functioning. Here, we synthesise these recent developments and propose that visuospatial coding scaffolds human cognition by providing a reference frame through which neural computations interface with environmental statistics and task demands via perception-action loops.

Functional organization of spatial frequency tuning in macaque V1 revealed with two-photon calcium imaging

V1 neurons are functionally organized in orientation columns in primates. Whether spatial frequency (SF) columns also exist is less clear because mixed results have been reported. A definitive solution would be SF functional maps at single-neuron resolution. Here we used two-photon calcium imaging to construct first cellular SF maps in V1 superficial layers of five awake fixating macaques, and studied SF functional organization properties and neuronal tuning characteristics. The SF maps (850 × 850 μm²) showed weak horizontal SF clustering (median clustering index = 1.43 vs. unity baseline), about one sixth as strong as orientation clustering in the same sets of neurons, which argues against a meaningful orthogonal relationship between orientation and SF functional maps. These maps also displayed nearly absent vertical SF clustering between two cortical depths (150 & 300 μm), indicating a lack of SF columnar structures within the superficial layers. The underlying causes might be that most neurons were tuned to a narrow two-octave range of medium frequencies, and many neurons with different SF preferences were often spatially mixed, which disallowed finer grouping of SF tuning. In addition, individual SF tuning functions were often asymmetric, having wider lower frequency branches, which may help encode low SF information for later decoding.

The Cortical Organization of Syntax

Syntax, the structure of sentences, enables humans to express an infinite range of meanings through finite means. The neurobiology of syntax has been intensely studied but with little consensus. Two main candidate regions have been identified: the posterior inferior frontal gyrus (pIFG) and the posterior middle temporal gyrus (pMTG). Integrating research in linguistics, psycholinguistics, and neuroscience, we propose a neuroanatomical framework for syntax that attributes distinct syntactic computations to these regions in a unified model. The key theoretical advances are adopting a modern lexicalized view of syntax in which the lexicon and syntactic rules are intertwined, and recognizing a computational asymmetry in the role of syntax during comprehension and production. Our model postulates a hierarchical lexical-syntactic function to the pMTG, which interconnects previously identified speech perception and conceptual-semantic systems in the temporal and inferior parietal lobes, crucial for both sentence production and comprehension. These relational hierarchies are transformed via the pIFG into morpho-syntactic sequences, primarily tied to production. We show how this architecture provides a better account of the full range of data and is consistent with recent proposals regarding the organization of phonological processes in the brain.

Small universal spiking neural P systems with dendritic/axonal delays and dendritic trunk/feedback

In spiking neural P (SN P) systems, neurons are interconnected by means of synapses, and they use spikes to communicate with each other. However, in biology, the complex structure of dendritic tree is also an important part in the communication scheme between neurons since these structures are linked to advanced neural process such as learning and memory formation. In this work, we present a new variant of the SN P systems inspired by diverse dendrite and axon phenomena such as dendritic feedback, dendritic trunk, dendritic delays and axonal delays, respectively. This new variant is referred to as a spiking neural P system with dendritic and axonal computation (DACSN P system). Specifically, we include experimentally proven biological features in the current SN P systems to reduce the computational complexity of the soma by providing it with stable firing patterns through dendritic delays, dendritic feedback and axonal delays. As a consequence, the proposed DACSN P systems use the minimum number of synapses and neurons with simple and homogeneous standard spiking rules. Here, we study the computational capabilities of a DACSN P system. In particular, we prove that DACSN P systems with dendritic and axonal behavior are universal as both number-accepting/generating devices. In addition, we constructed a small universal SN P system using 39 neurons with standard spiking rules to compute any Turing computable function.

Comprehension of computer code relies primarily on domain-general executive brain regions

Computer programming is a novel cognitive tool that has transformed modern society. What cognitive and neural mechanisms support this skill? Here, we used functional magnetic resonance imaging to investigate two candidate brain systems: the multiple demand (MD) system, typically recruited during math, logic, problem solving, and executive tasks, and the language system, typically recruited during linguistic processing. We examined MD and language system responses to code written in Python, a text-based programming language (Experiment 1) and in ScratchJr, a graphical programming language (Experiment 2); for both, we contrasted responses to code problems with responses to content-matched sentence problems. We found that the MD system exhibited strong bilateral responses to code in both experiments, whereas the language system responded strongly to sentence problems, but weakly or not at all to code problems. Thus, the MD system supports the use of novel cognitive tools even when the input is structurally similar to natural language.

Enhanced representation of natural sound sequences in the ventral auditory midbrain

The auditory midbrain (inferior colliculus, IC) plays an important role in sound processing, acting as hub for acoustic information extraction and for the implementation of fast audio-motor behaviors. IC neurons are topographically organized according to their sound frequency preference: dorsal IC regions encode low frequencies while ventral areas respond best to high frequencies, a type of sensory map defined as tonotopy. Tonotopic maps have been studied extensively using artificial stimuli (pure tones) but our knowledge of how these maps represent information about sequences of natural, spectro-temporally rich sounds is sparse. We studied this question by conducting simultaneous extracellular recordings across IC depths in awake bats (Carollia perspicillata) that listened to sequences of natural communication and echolocation sounds. The hypothesis was that information about these two types of sound streams is represented at different IC depths since they exhibit large differences in spectral composition, i.e., echolocation covers the high-frequency portion of the bat soundscape (> 45 kHz), while communication sounds are broadband and carry most power at low frequencies (20–25 kHz). Our results showed that mutual information between neuronal responses and acoustic stimuli, as well as response redundancy in pairs of neurons recorded simultaneously, increase exponentially with IC depth. The latter occurs regardless of the sound type presented to the bats (echolocation or communication). Taken together, our results indicate the existence of mutual information and redundancy maps at the midbrain level whose response cannot be predicted based on the frequency composition of natural sounds and classic neuronal tuning curves.

Spatial clustering of orientation preference in primary visual cortex of the large rodent agouti

All rodents investigated so far possess orientation-selective neurons in the primary visual cortex (V1) but – in contrast to carnivores and primates – no evidence of periodic maps with pinwheel-like structures. Theoretical studies debating whether phylogeny or universal principles determine development of pinwheels point to V1 size as a critical constraint. Thus, we set out to study maps of agouti, a big diurnal rodent with a V1 size comparable to cats'. In electrophysiology, we detected interspersed orientation and direction-selective neurons with a bias for horizontal contours, corroborated by homogeneous activation in optical imaging. Compatible with spatial clustering at short distance, nearby neurons tended to exhibit similar orientation preference. Our results argue against V1 size as a key parameter in determining the presence of periodic orientation maps. They are consistent with a phylogenetic influence on the map layout and development, potentially reflecting distinct retinal traits or interspecies differences in cortical circuitry.

•

Agouti V1 neurons are among the highest orientation- and direction-selective neurons in rodents

•

They respond best to low spatial frequencies and with a bias for horizontal orientations

•

There is no evidence of systematic periodic maps of orientation columns for agouti

•

Neurons along the vertical cortical axis tend to have similar orientation preferences

Colored visual stimuli evoke spectrally tuned neuronal responses across the central nervous system of zebrafish larvae

BACKGROUND

Visually guided behaviors such as optomotor and optokinetic responses, phototaxis, and prey capture are crucial for survival in zebrafish and become apparent after just a few days of development. Color vision, which in zebrafish is based on a spatially anisotropic tetrachromatic retina, provides an additional important component of world representation driving fundamental larval behaviors. However, little is known about the central nervous system (CNS) circuitry underlying color vision processing downstream of the retina, and its activity correlates with behavior. Here, we used the transparent larva of zebrafish to image CNS neurons and their activity in response to colored visual stimuli.

RESULTS

To investigate the processing of chromatic information in the zebrafish larva brain, we mapped with cellular resolution, spectrally responsive neurons in the larva encephalon and spinal cord. We employed the genetically encoded calcium indicator GCaMP6s and two-photon microscopy to image the neuronal activity while performing visual stimulation with spectrally distinct stimuli at wavelengths matching the absorption peaks of the four zebrafish cone types. We observed the presence of a high number of wavelength-selective neurons not only in the optic tectum, but also in all other regions of the CNS, demonstrating that the circuitry involved in processing spectral information and producing color-selective responses extends to the whole CNS.

CONCLUSIONS

Our measurements provide a map of neurons involved in color-driven responses, revealing that spectral information spreads in all regions of the CNS. This suggests the underlying complexity of the circuits involved and opens the way to their detailed future investigation.

Curvature-processing domains in primate V4

Neurons in primate V4 exhibit various types of selectivity for contour shapes, including curves, angles, and simple shapes. How are these neurons organized in V4 remains unclear. Using intrinsic signal optical imaging and two-photon calcium imaging, we observed submillimeter functional domains in V4 that contained neurons preferring curved contours over rectilinear ones. These curvature domains had similar sizes and response amplitudes as orientation domains but tended to separate from these regions. Within the curvature domains, neurons that preferred circles or curve orientations clustered further into finer scale subdomains. Nevertheless, individual neurons also had a wide range of contour selectivity, and neighboring neurons exhibited a substantial diversity in shape tuning besides their common shape preferences. In strong contrast to V4, V1 and V2 did not have such contour-shape-related domains. These findings highlight the importance and complexity of curvature processing in visual object recognition and the key functional role of V4 in this process.

Spatial readout of visual looming in the central brain of Drosophila

Visual systems can exploit spatial correlations in the visual scene by using retinotopy, the organizing principle by which neighboring cells encode neighboring spatial locations. However, retinotopy is often lost, such as when visual pathways are integrated with other sensory modalities. How is spatial information processed outside of strictly visual brain areas? Here, we focused on visual looming responsive LC6 cells in Drosophila, a population whose dendrites collectively cover the visual field, but whose axons form a single glomerulus-a structure without obvious retinotopic organization-in the central brain. We identified multiple cell types downstream of LC6 in the glomerulus and found that they more strongly respond to looming in different portions of the visual field, unexpectedly preserving spatial information. Through EM reconstruction of all LC6 synaptic inputs to the glomerulus, we found that LC6 and downstream cell types form circuits within the glomerulus that enable spatial readout of visual features and contralateral suppression-mechanisms that transform visual information for behavioral control.

Generative network models of altered structural brain connectivity in schizophrenia

Alterations in the structural connectome of schizophrenia patients have been widely characterized, but the mechanisms remain largely unknown. Generative network models have recently been introduced as a tool to test the biological underpinnings of altered brain network formation. We evaluated different generative network models in healthy controls (n=152), schizophrenia patients (n=66), and their unaffected first-degree relatives (n=32), and we identified spatial and topological factors contributing to network formation. We further investigated how these factors relate to cognition and to polygenic risk for schizophrenia. Our data show that among the four tested classes of generative network models, structural brain networks were optimally accounted for by a two-factor model combining spatial constraints and topological neighborhood structure. The same wiring model explained brain network formation across study groups. However, relatives and schizophrenia patients exhibited significantly lower spatial constraints and lower topological facilitation compared to healthy controls. Further exploratory analyses point to potential associations of the model parameter reflecting spatial constraints with the polygenic risk for schizophrenia and cognitive performance. Our results identify spatial constraints and local topological structure as two interrelated mechanisms contributing to regular brain network formation as well as altered connectomes in schizophrenia and healthy individuals at familial risk for schizophrenia. On an exploratory level, our data further point to the potential relevance of spatial constraints for the genetic risk for schizophrenia and general cognitive functioning, thereby encouraging future studies in following up on these observations to gain further insights into the biological basis and behavioral relevance of model parameters.

Early Emergence of Solid Shape Coding in Natural and Deep Network Vision

Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape-processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep-network training.

Increased wiring cost during development is driven by long-range cortical, but not subcortical connections

The brain undergoes a protracted, metabolically expensive maturation process from childhood to adulthood. Therefore, it is crucial to understand how network cost is distributed among different brain systems as the brain matures. To address this issue, here we examined developmental changes in wiring cost and brain network topology using resting-state functional magnetic resonance imaging (rsfMRI) data longitudinally collected in awake rats from the juvenile age to adulthood. We found that the wiring cost increased in the vast majority of cortical connections but decreased in most subcortico-subcortical connections. Importantly, the developmental increase in wiring cost was dominantly driven by long-range cortical, but not subcortical connections, which was consistent with more pronounced increase in network integration in the cortical network. These results collectively indicate that there is a non-uniform distribution of network cost as the brain matures, and network resource is dominantly consumed for the development of the cortex, but not subcortex from the juvenile age to adulthood.

Refractory density model of cortical direction selectivity: Lagged-nonlagged, transient-sustained, and On-Off thalamic neuron-based mechanisms and intracortical amplification

A biophysically detailed description of the mechanisms of the primary vision is still being developed. We have incorporated a simplified, filter-based description of retino-thalamic visual signal processing into the detailed, conductance-based refractory density description of the neuronal population activity of the primary visual cortex. We compared four mechanisms of the direction selectivity (DS), three of them being based on asymmetrical projections of different types of thalamic neurons to the cortex, distinguishing between (i) lagged and nonlagged, (ii) transient and sustained, and (iii) On and Off neurons. The fourth mechanism implies a lack of subcortical bias and is an epiphenomenon of intracortical interactions between orientation columns. The simulations of the cortical response to moving gratings have verified that first three mechanisms provide DS to an extent compared with experimental data and that the biophysical model realistically reproduces characteristics of the visual cortex activity, such as membrane potential, firing rate, and synaptic conductances. The proposed model reveals the difference between the mechanisms of both the intact and the silenced cortex, favoring the second mechanism. In the fourth case, DS is weaker but significant; it completely vanishes in the silenced cortex.DS in the On-Off mechanism derives from the nonlinear interactions within the orientation map. Results of simulations can help to identify a prevailing mechanism of DS in V1. This is a step towards a comprehensive biophysical modeling of the primary visual system in the frameworks of the population rate coding concept.

A major mechanism that underlies tuning of cortical neurons to the direction of a moving stimulus is still debated. Considering the visual cortex structured with orientation-selective columns, we have realized and compared in our biophysically detailed mathematical model four hypothetical mechanisms of the direction selectivity (DS) known from experiments. The present model accomplishes our previous model that was tuned to experimental data on excitability in slices and reproduces orientation tuning effects in vivo. In simulations, we have found that the convergence of inputs from so-called transient and sustained (or lagged and nonlagged) thalamic neurons in the cortex provides an initial bias for DS, whereas cortical interactions amplify the tuning. In the absence of any bias, DS emerges as an epiphenomenon of the orientation map. In the case of a biased convergence of On- and Off- thalamic inputs, DS emerges with the help of the intracortical interactions on the orientation map, also. Thus, we have proposed a comprehensive description of the primary vision and revealed characteristic features of different mechanisms of DS in the visual cortex with columnar structure.

Peeling the Onion of Brain Representations

The brain's function is to enable adaptive behavior in the world. To this end, the brain processes information about the world. The concept of representation links the information processed by the brain back to the world and enables us to understand what the brain does at a functional level. The appeal of making the connection between brain activity and what it represents has been irresistible to neuroscience, despite the fact that representational interpretations pose several challenges: We must define which aspects of brain activity matter, how the code works, and how it supports computations that contribute to adaptive behavior. It has been suggested that we might drop representational language altogether and seek to understand the brain, more simply, as a dynamical system. In this review, we argue that the concept of representation provides a useful link between dynamics and computational function and ask which aspects of brain activity should be analyzed to achieve a representational understanding. We peel the onion of brain representations in search of the layers (the aspects of brain activity) that matter to computation. The article provides an introduction to the motivation and mathematics of representational models, a critical discussion of their assumptions and limitations, and a preview of future directions in this area.

Seeing Natural Images through the Eye of a Fly with Remote Focusing Two-Photon Microscopy

Visual systems of many animals, including the fruit fly Drosophila, represent the surrounding space as 2D maps, formed by populations of neurons. Advanced genetic tools make the fly visual system especially well accessible. However, in typical in vivo preparations for two-photon calcium imaging, relatively few neurons can be recorded at the same time. Here, we present an extension to a conventional two-photon microscope, based on remote focusing, which enables real-time rotation of the imaging plane, and thus flexible alignment to cellular structures, without resolution or speed trade-off. We simultaneously record from over 100 neighboring cells spanning the 2D retinotopic map. We characterize its representation of moving natural images, which we find is comparable to noise predictions. Our method increases throughput 10-fold and allows us to visualize a significant fraction of the fly's visual field. Furthermore, our system can be applied in general for a more flexible investigation of neural circuits.

Retinoic Acid Organizes the Zebrafish Vagus Motor Topographic Map via Spatiotemporal Coordination of Hgf/Met Signaling

Information flow through neural circuits often requires their organization into topographic maps in which the positions of cell bodies and synaptic targets correspond. To understand how topographic map development is controlled, we examine the mechanism underlying targeting of vagus motor axons to the pharyngeal arches in zebrafish. We reveal that retinoic acid organizes topography by specifying anterior-posterior identity in vagus motor neurons. We then show that chemoattractant signaling between Hgf and Met is required for vagus innervation of the pharyngeal arches. Finally, we find that retinoic acid controls the spatiotemporal dynamics of Hgf/Met signaling to coordinate axon targeting with the developmental progression of the pharyngeal arches and show that experimentally altering the timing of Hgf/Met signaling is sufficient to redirect axon targeting and disrupt the topographic map. These findings establish a mechanism of topographic map development in which the regulation of chemoattractant signaling in space and time guides axon targeting.

Prediction and Dissipation in Nonequilibrium Molecular Sensors: Conditionally Markovian Channels Driven by Memoryful Environments

Biological sensors must often predict their input while operating under metabolic constraints. However, determining whether or not a particular sensor is evolved or designed to be accurate and efficient is challenging. This arises partly from the functional constraints being at cross purposes and partly since quantifying the prediction performance of even in silico sensors can require prohibitively long simulations, especially when highly complex environments drive sensors out of equilibrium. To circumvent these difficulties, we develop new expressions for the prediction accuracy and thermodynamic costs of the broad class of conditionally Markovian sensors subject to complex, correlated (unifilar hidden semi-Markov) environmental inputs in nonequilibrium steady state. Predictive metrics include the instantaneous memory and the total predictable information (the mutual information between present sensor state and input future), while dissipation metrics include power extracted from the environment and the nonpredictive information rate. Success in deriving these formulae relies on identifying the environment's causal states, the input's minimal sufficient statistics for prediction. Using these formulae, we study large random channels and the simplest nontrivial biological sensor model-that of a Hill molecule, characterized by the number of ligands that bind simultaneously-the sensor's cooperativity. We find that the seemingly impoverished Hill molecule can capture an order of magnitude more predictable information than large random channels.

Computational exploration of molecular receptive fields in the olfactory bulb reveals a glomerulus-centric chemical map

Progress in olfactory research is currently hampered by incomplete knowledge about chemical receptive ranges of primary receptors. Moreover, the chemical logic underlying the arrangement of computational units in the olfactory bulb has still not been resolved. We undertook a large-scale approach at characterising molecular receptive ranges (MRRs) of glomeruli in the dorsal olfactory bulb (dOB) innervated by the MOR18-2 olfactory receptor, also known as Olfr78, with human ortholog OR51E2. Guided by an iterative approach that combined biological screening and machine learning, we selected 214 odorants to characterise the response of MOR18-2 and its neighbouring glomeruli. We found that a combination of conventional physico-chemical and vibrational molecular descriptors performed best in predicting glomerular responses using nonlinear Support-Vector Regression. We also discovered several previously unknown odorants activating MOR18-2 glomeruli, and obtained detailed MRRs of MOR18-2 glomeruli and their neighbours. Our results confirm earlier findings that demonstrated tunotopy, that is, glomeruli with similar tuning curves tend to be located in spatial proximity in the dOB. In addition, our results indicate chemotopy, that is, a preference for glomeruli with similar physico-chemical MRR descriptions being located in spatial proximity. Together, these findings suggest the existence of a partial chemical map underlying glomerular arrangement in the dOB. Our methodology that combines machine learning and physiological measurements lights the way towards future high-throughput studies to deorphanise and characterise structure-activity relationships in olfaction.

A Model of Brain Folding Based on Strong Local and Weak Long-Range Connectivity Requirements

Throughout the animal kingdom, the structure of the central nervous system varies widely from distributed ganglia in worms to compact brains with varying degrees of folding in mammals. The differences in structure may indicate a fundamentally different circuit organization. However, the folded brain most likely is a direct result of mechanical forces when considering that a larger surface area of cortex packs into the restricted volume provided by the skull. Here, we introduce a computational model that instead of modeling mechanical forces relies on dimension reduction methods to place neurons according to specific connectivity requirements. For a simplified connectivity with strong local and weak long-range connections, our model predicts a transition from separate ganglia through smooth brain structures to heavily folded brains as the number of cortical columns increases. The model reproduces experimentally determined relationships between metrics of cortical folding and its pathological phenotypes in lissencephaly, polymicrogyria, microcephaly, autism, and schizophrenia. This suggests that mechanical forces that are known to lead to cortical folding may synergistically contribute to arrangements that reduce wiring. Our model provides a unified conceptual understanding of gyrification linking cellular connectivity and macroscopic structures in large-scale neural network models of the brain.

Enrichment drives emergence of functional columns and improves sensory coding in the whisker map in L2/3 of mouse S1

Sensory maps in layer (L) 2/3 of rodent cortex lack precise functional column boundaries, and instead exhibit locally heterogeneous (salt-and-pepper) tuning superimposed on smooth global topography. Could this organization be a byproduct of impoverished experience in laboratory housing? We compared whisker map somatotopy in L2/3 and L4 excitatory cells of somatosensory (S1) cortex in normally housed vs. tactile-enriched mice, using GCaMP6s imaging. Normally housed mice had a dispersed, salt-and-pepper whisker map in L2/3, but L4 was more topographically precise. Enrichment (P21 to P46-71) sharpened whisker tuning and decreased, but did not abolish, local tuning heterogeneity. In L2/3, enrichment strengthened and sharpened whisker point representations, and created functional boundaries of tuning similarity and noise correlations at column edges. Thus, enrichment drives emergence of functional columnar topography in S1, and reduces local tuning heterogeneity. These changes predict better touch detection by neural populations within each column.

Coding of low-level position and orientation information in human naturalistic vision

Orientation and position of small image segments are considered to be two fundamental low-level attributes in early visual processing, yet their encoding in complex natural stimuli is underexplored. By measuring the just-noticeable differences in noise perturbation, we investigated how orientation and position information of a large number of local elements (Gabors) were encoded separately or jointly. Importantly, the Gabors composed various classes of naturalistic stimuli that were equated by all low-level attributes and differed only in their higher-order configural complexity and familiarity. Although unable to consciously tell apart the type of perturbation, observers detected orientation and position noise significantly differently. Furthermore, when the Gabors were perturbed by both types of noise simultaneously, performance adhered to a reliability-based optimal probabilistic combination of individual attribute noises. Our results suggest that orientation and position are independently coded and probabilistically combined for naturalistic stimuli at the earliest stage of visual processing.

Topographic Maps: Motor Axons Wait Their Turn

Topographic maps are a basic organizational feature of nervous systems, and their construction involves both spatial and temporal cues. A recent study reports a novel mechanism of topographic map formation which relies on the timing of axon initiation.

Comparing Bayesian and non-Bayesian accounts of human confidence reports

Humans can meaningfully report their confidence in a perceptual or cognitive decision. It is widely believed that these reports reflect the Bayesian probability that the decision is correct, but this hypothesis has not been rigorously tested against non-Bayesian alternatives. We use two perceptual categorization tasks in which Bayesian confidence reporting requires subjects to take sensory uncertainty into account in a specific way. We find that subjects do take sensory uncertainty into account when reporting confidence, suggesting that brain areas involved in reporting confidence can access low-level representations of sensory uncertainty, a prerequisite of Bayesian inference. However, behavior is not fully consistent with the Bayesian hypothesis and is better described by simple heuristic models that use uncertainty in a non-Bayesian way. Both conclusions are robust to changes in the uncertainty manipulation, task, response modality, model comparison metric, and additional flexibility in the Bayesian model. Our results suggest that adhering to a rational account of confidence behavior may require incorporating implementational constraints.

A Blind Stereoscopic Image Quality Evaluator with Segmented Stacked Autoencoders Considering The Whole Visual Perception Route

Most of the current blind stereoscopic image quality assessment (SIQA) algorithms cannot show reliable accuracy. One reason is that they do not have the deep architectures and the other reason is that they are designed on the relatively weak biological basis, compared with findings on human visual system (HVS). In this paper, we propose a Deep Edge and COlor Signal INtegrity Evaluator (DECOSINE) based on the whole visual perception route from eyes to the frontal lobe, and especially focus on edge and color signal processing in retinal ganglion cells (RGC) and lateral geniculate nucleus (LGN). Furthermore, to model the complex and deep structure of the visual cortex, Segmented Stacked Auto-encoder (S-SAE) is used, which has not utilized for SIQA before. The utilization of the S-SAE complements weakness of deep learning-based SIQA metrics that require a very long training time. Experiments are conducted on popular SIQA databases, and the superiority of DECOSINE in terms of prediction accuracy and monotonicity is proved. The experimental results show that our model about the whole visual perception route and utilization of S-SAE are effective for SIQA.