Neural Circuit Inference from Function to Structure

Filter-based models of suppression in retinal ganglion cells: Comparison and generalization across species and stimuli

The dichotomy of excitation and suppression is one of the canonical mechanisms explaining the complexity of neural activity. Computational models of the interplay of excitation and suppression in single neurons aim at investigating how this interaction affects a neuron's spiking responses and shapes the encoding of sensory stimuli. Here, we compare the performance of three filter-based stimulus-encoding models for predicting retinal ganglion cell responses recorded from axolotl, mouse, and marmoset retina to different types of temporally varying visual stimuli. Suppression in these models is implemented via subtractive or divisive interactions of stimulus filters or by a response-driven feedback module. For the majority of ganglion cells, the subtractive and divisive models perform similarly and outperform the feedback model as well as a linear-nonlinear (LN) model with no suppression. Comparison between the subtractive and the divisive model depends on cell type, species, and stimulus components, with the divisive model generalizing best across temporal stimulus frequencies and visual contrast and the subtractive model capturing in particular responses for slow temporal stimulus dynamics and for slow axolotl cells. Overall, we conclude that the divisive and subtractive models are well suited for capturing interactions of excitation and suppression in ganglion cells and perform best for different temporal regimes of these interactions.

Applying Super-Resolution and Tomography Concepts to Identify Receptive Field Subunits in the Retina

Spatially nonlinear stimulus integration by retinal ganglion cells lies at the heart of various computations performed by the retina. It arises from the nonlinear transmission of signals that ganglion cells receive from bipolar cells, which thereby constitute functional subunits within a ganglion cell's receptive field. Inferring these subunits from recorded ganglion cell activity promises a new avenue for studying the functional architecture of the retina. This calls for efficient methods, which leave sufficient experimental time to leverage the acquired knowledge for further investigating identified subunits. Here, we combine concepts from super-resolution microscopy and computed tomography and introduce super-resolved tomographic reconstruction (STR) as a technique to efficiently stimulate and locate receptive field subunits. Simulations demonstrate that this approach can reliably identify subunits across a wide range of model variations, and application in recordings of primate parasol ganglion cells validates the experimental feasibility. STR can potentially reveal comprehensive subunit layouts within only a few tens of minutes of recording time, making it ideal for online analysis and closed-loop investigations of receptive field substructure in retina recordings.

Self-gating stochastic-resonance-based autoencoder for unsupervised learning

Incorporating additive noise components to an ensemble of McCulloch-Pitts neurons can enhance the information representation of the input, asymptotically approaching the average firing probability for large enough ensembles. We further multiply the input by the average firing probability to control the higher probability of self-gating, thereby forming a unified noise-boosted activation model with learnable noise-related hyperparameters. This gating strategy plays a crucial role in improving the performance of neural networks, as evidenced by the optimization of the autoencoder loss at nonzero optimal-noise-scaling hyperparameters, a phenomenon termed self-gating stochastic resonance. Experiments with designed autoencoders using noise-boosted activation functions demonstrate the potential applications of the self-gating stochastic resonance effect in the field of unsupervised learning.

Emergence of input selective recurrent dynamics via information transfer maximization

Network structures of the brain have wiring patterns specialized for specific functions. These patterns are partially determined genetically or evolutionarily based on the type of task or stimulus. These wiring patterns are important in information processing; however, their organizational principles are not fully understood. This study frames the maximization of information transmission alongside the reduction of maintenance costs as a multi-objective optimization challenge, utilizing information theory and evolutionary computing algorithms with an emphasis on the visual system. The goal is to understand the underlying principles of circuit formation by exploring the patterns of wiring and information processing. The study demonstrates that efficient information transmission necessitates sparse circuits with internal modular structures featuring distinct wiring patterns. Significant trade-offs underscore the necessity of balance in wiring pattern development. The dynamics of effective circuits exhibit moderate flexibility in response to stimuli, in line with observations from prior visual system studies. Maximizing information transfer may allow for the self-organization of information processing functions similar to actual biological circuits, without being limited by modality. This study offers insights into neuroscience and the potential to improve reservoir computing performance.

Anatomo-functional correspondence in the voice-selective regions of human prefrontal cortex

Group level analyses of functional regions involved in voice perception show evidence of 3 sets of bilateral voice-sensitive activations in the human prefrontal cortex, named the anterior, middle and posterior Frontal Voice Areas (FVAs). However, the relationship with the underlying sulcal anatomy, highly variable in this region, is still unknown. We examined the inter-individual variability of the FVAs in conjunction with the sulcal anatomy. To do so, anatomical and functional MRI scans from 74 subjects were analyzed to generate individual contrast maps of the FVAs and relate them to each subject's manually labeled prefrontal sulci. We report two major results. First, the frontal activations for the voice are significantly associated with the sulcal anatomy. Second, this correspondence with the sulcal anatomy at the individual level is a better predictor than coordinates in the MNI space. These findings offer new perspectives for the understanding of anatomical-functional correspondences in this complex cortical region. They also shed light on the importance of considering individual-specific variations in subject's anatomy.

Efficient coding of natural scenes improves neural system identification

Neural system identification aims at learning the response function of neurons to arbitrary stimuli using experimentally recorded data, but typically does not leverage normative principles such as efficient coding of natural environments. Visual systems, however, have evolved to efficiently process input from the natural environment. Here, we present a normative network regularization for system identification models by incorporating, as a regularizer, the efficient coding hypothesis, which states that neural response properties of sensory representations are strongly shaped by the need to preserve most of the stimulus information with limited resources. Using this approach, we explored if a system identification model can be improved by sharing its convolutional filters with those of an autoencoder which aims to efficiently encode natural stimuli. To this end, we built a hybrid model to predict the responses of retinal neurons to noise stimuli. This approach did not only yield a higher performance than the "stand-alone" system identification model, it also produced more biologically plausible filters, meaning that they more closely resembled neural representation in early visual systems. We found these results applied to retinal responses to different artificial stimuli and across model architectures. Moreover, our normatively regularized model performed particularly well in predicting responses of direction-of-motion sensitive retinal neurons. The benefit of natural scene statistics became marginal, however, for predicting the responses to natural movies. In summary, our results indicate that efficiently encoding environmental inputs can improve system identification models, at least for noise stimuli, and point to the benefit of probing the visual system with naturalistic stimuli.

Retinal Encoding of Natural Scenes

An ultimate goal in retina science is to understand how the neural circuit of the retina processes natural visual scenes. Yet most studies in laboratories have long been performed with simple, artificial visual stimuli such as full-field illumination, spots of light, or gratings. The underlying assumption is that the features of the retina thus identified carry over to the more complex scenario of natural scenes. As the application of corresponding natural settings is becoming more commonplace in experimental investigations, this assumption is being put to the test and opportunities arise to discover processing features that are triggered by specific aspects of natural scenes. Here, we review how natural stimuli have been used to probe, refine, and complement knowledge accumulated under simplified stimuli, and we discuss challenges and opportunities along the way toward a comprehensive understanding of the encoding of natural scenes. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Fixed Point Attractor Theory Bridges Structure and Function in C. elegans Neuronal Network

Understanding the structure–function relationship in a neuronal network is one of the major challenges in neuroscience research. Despite increasing researches at circuit connectivity and neural network structure, their structure-based biological interpretability remains unclear. Based on the attractor theory, here we develop an analytical framework that links neural circuit structures and their functions together through fixed point attractor in Caenorhabditis elegans. In this framework, we successfully established the structural condition for the emergence of multiple fixed points in C. elegans connectome. Then we construct a finite state machine to explain how functions related to bistable phenomena at the neural activity and behavioral levels are encoded. By applying the proposed framework to the command circuit in C. elegans, we provide a circuit level interpretation for the forward-reverse switching behaviors. Interestingly, network properties of the command circuit and first layer amphid interneuron circuit can also be inferred from their functions in this framework. Our research indicates the reliability of the fixed point attractor bridging circuit structure and functions, suggesting its potential applicability to more complex neuronal circuits in other species.

Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration

A central goal in sensory neuroscience is to understand the neuronal signal processing involved in the encoding of natural stimuli. A critical step towards this goal is the development of successful computational encoding models. For ganglion cells in the vertebrate retina, the development of satisfactory models for responses to natural visual scenes is an ongoing challenge. Standard models typically apply linear integration of visual stimuli over space, yet many ganglion cells are known to show nonlinear spatial integration, in particular when stimulated with contrast-reversing gratings. We here study the influence of spatial nonlinearities in the encoding of natural images by ganglion cells, using multielectrode-array recordings from isolated salamander and mouse retinas. We assess how responses to natural images depend on first- and second-order statistics of spatial patterns inside the receptive field. This leads us to a simple extension of current standard ganglion cell models. We show that taking not only the weighted average of light intensity inside the receptive field into account but also its variance over space can partly account for nonlinear integration and substantially improve response predictions of responses to novel images. For salamander ganglion cells, we find that response predictions for cell classes with large receptive fields profit most from including spatial contrast information. Finally, we demonstrate how this model framework can be used to assess the spatial scale of nonlinear integration. Our results underscore that nonlinear spatial stimulus integration translates to stimulation with natural images. Furthermore, the introduced model framework provides a simple, yet powerful extension of standard models and may serve as a benchmark for the development of more detailed models of the nonlinear structure of receptive fields.

For understanding how sensory systems operate in the natural environment, an important goal is to develop models that capture neuronal responses to natural stimuli. For retinal ganglion cells, which connect the eye to the brain, current standard models often fail to capture responses to natural visual scenes. This shortcoming is at least partly rooted in the fact that ganglion cells may combine visual signals over space in a nonlinear fashion. We here show that a simple model, which not only considers the average light intensity inside a cell’s receptive field but also the variance of light intensity over space, can partly account for these nonlinearities and thereby improve current standard models. This provides an easy-to-obtain benchmark for modeling ganglion cell responses to natural images.

Retina organoids: Window into the biophysics of neuronal systems

With a kind of magnetism, the human retina draws the eye of neuroscientist and physicist alike. It is attractive as a self-organizing system, which forms as a part of the central nervous system via biochemical and mechanical cues. The retina is also intriguing as an electro-optical device, converting photons into voltages to perform on-the-fly filtering before the signals are sent to our brain. Here, we consider how the advent of stem cell derived in vitro analogs of the retina, termed retina organoids, opens up an exploration of the interplay between optics, electrics, and mechanics in a complex neuronal network, all in a Petri dish. This review presents state-of-the-art retina organoid protocols by emphasizing links to the biochemical and mechanical signals of in vivo retinogenesis. Electrophysiological recording of active signal processing becomes possible as retina organoids generate light sensitive and synaptically connected photoreceptors. Experimental biophysical tools provide data to steer the development of mathematical models operating at different levels of coarse-graining. In concert, they provide a means to study how mechanical factors guide retina self-assembly. In turn, this understanding informs the engineering of mechanical signals required to tailor the growth of neuronal network morphology. Tackling the complex developmental and computational processes in the retina requires an interdisciplinary endeavor combining experiment and theory, physics, and biology. The reward is enticing: in the next few years, retina organoids could offer a glimpse inside the machinery of simultaneous cellular self-assembly and signal processing, all in an in vitro setting.

Scalable and accurate method for neuronal ensemble detection in spiking neural networks

We propose a novel, scalable, and accurate method for detecting neuronal ensembles from a population of spiking neurons. Our approach offers a simple yet powerful tool to study ensemble activity. It relies on clustering synchronous population activity (population vectors), allows the participation of neurons in different ensembles, has few parameters to tune and is computationally efficient. To validate the performance and generality of our method, we generated synthetic data, where we found that our method accurately detects neuronal ensembles for a wide range of simulation parameters. We found that our method outperforms current alternative methodologies. We used spike trains of retinal ganglion cells obtained from multi-electrode array recordings under a simple ON-OFF light stimulus to test our method. We found a consistent stimuli-evoked ensemble activity intermingled with spontaneously active ensembles and irregular activity. Our results suggest that the early visual system activity could be organized in distinguishable functional ensembles. We provide a Graphic User Interface, which facilitates the use of our method by the scientific community.

Feedback from retinal ganglion cells to the inner retina

Retinal ganglion cells (RGCs) are thought to be strictly postsynaptic within the retina. They carry visual signals from the eye to the brain, but do not make chemical synapses onto other retinal neurons. Nevertheless, they form gap junctions with other RGCs and amacrine cells, providing possibilities for RGC signals to feed back into the inner retina. Here we identified such feedback circuitry in the salamander and mouse retinas. First, using biologically inspired circuit models, we found mutual inhibition among RGCs of the same type. We then experimentally determined that this effect is mediated by gap junctions with amacrine cells. Finally, we found that this negative feedback lowers RGC visual response gain without affecting feature selectivity. The principal neurons of the retina therefore participate in a recurrent circuit much as those in other brain areas, not being a mere collector of retinal signals, but are actively involved in visual computations.

Nonlinear Spatial Integration Underlies the Diversity of Retinal Ganglion Cell Responses to Natural Images

How neurons encode natural stimuli is a fundamental question for sensory neuroscience. In the early visual system, standard encoding models assume that neurons linearly filter incoming stimuli through their receptive fields, but artificial stimuli, such as contrast-reversing gratings, often reveal nonlinear spatial processing. We investigated to what extent such nonlinear processing is relevant for the encoding of natural images in retinal ganglion cells in mice of either sex.

How neurons encode natural stimuli is a fundamental question for sensory neuroscience. In the early visual system, standard encoding models assume that neurons linearly filter incoming stimuli through their receptive fields, but artificial stimuli, such as contrast-reversing gratings, often reveal nonlinear spatial processing. We investigated to what extent such nonlinear processing is relevant for the encoding of natural images in retinal ganglion cells in mice of either sex. We found that standard linear receptive field models yielded good predictions of responses to flashed natural images for a subset of cells but failed to capture the spiking activity for many others. Cells with poor model performance displayed pronounced sensitivity to fine spatial contrast and local signal rectification as the dominant nonlinearity. By contrast, sensitivity to high-frequency contrast-reversing gratings, a classical test for nonlinear spatial integration, was not a good predictor of model performance and thus did not capture the variability of nonlinear spatial integration under natural images. In addition, we also observed a class of nonlinear ganglion cells with inverse tuning for spatial contrast, responding more strongly to spatially homogeneous than to spatially structured stimuli. These findings highlight the diversity of receptive field nonlinearities as a crucial component for understanding early sensory encoding in the context of natural stimuli.

SIGNIFICANCE STATEMENT Experiments with artificial visual stimuli have revealed that many types of retinal ganglion cells pool spatial input signals nonlinearly. However, it is still unclear how relevant this nonlinear spatial integration is when the input signals are natural images. Here we analyze retinal responses to natural scenes in large populations of mouse ganglion cells. We show that nonlinear spatial integration strongly influences responses to natural images for some ganglion cells, but not for others. Cells with nonlinear spatial integration were sensitive to spatial structure inside their receptive fields, and a small group of cells displayed a surprising sensitivity to spatially homogeneous stimuli. Traditional analyses with contrast-reversing gratings did not predict this variability of nonlinear spatial integration under natural images.

Anatomy and activity patterns in a multifunctional motor neuron and its surrounding circuits

Dorsal Excitor motor neuron DE-3 in the medicinal leech plays three very different dynamical roles in three different behaviors. Without rewiring its anatomical connectivity, how can a motor neuron dynamically switch roles to play appropriate roles in various behaviors? We previously used voltage-sensitive dye imaging to record from DE-3 and most other neurons in the leech segmental ganglion during (fictive) swimming, crawling, and local-bend escape (Tomina and Wagenaar, 2017). Here, we repeated that experiment, then re-imaged the same ganglion using serial blockface electron microscopy and traced DE-3's processes. Further, we traced back the processes of DE-3's presynaptic partners to their respective somata. This allowed us to analyze the relationship between circuit anatomy and the activity patterns it sustains. We found that input synapses important for all the behaviors were widely distributed over DE-3's branches, yet that functional clusters were different during (fictive) swimming vs. crawling.

What the salamander eye has been telling the vision scientist's brain

Salamanders have been habitual residents of research laboratories for more than a century, and their history in science is tightly interwoven with vision research. Nevertheless, many vision scientists - even those working with salamanders - may be unaware of how much our knowledge about vision, and particularly the retina, has been shaped by studying salamanders. In this review, we take a tour through the salamander history in vision science, highlighting the main contributions of salamanders to our understanding of the vertebrate retina. We further point out specificities of the salamander visual system and discuss the perspectives of this animal system for future vision research.

Inferring synaptic inputs from spikes with a conductance-based neural encoding model

Descriptive statistical models of neural responses generally aim to characterize the mapping from stimuli to spike responses while ignoring biophysical details of the encoding process. Here, we introduce an alternative approach, the conductance-based encoding model (CBEM), which describes a mapping from stimuli to excitatory and inhibitory synaptic conductances governing the dynamics of sub-threshold membrane potential. Remarkably, we show that the CBEM can be fit to extracellular spike train data and then used to predict excitatory and inhibitory synaptic currents. We validate these predictions with intracellular recordings from macaque retinal ganglion cells. Moreover, we offer a novel quasi-biophysical interpretation of the Poisson generalized linear model (GLM) as a special case of the CBEM in which excitation and inhibition are perfectly balanced. This work forges a new link between statistical and biophysical models of neural encoding and sheds new light on the biophysical variables that underlie spiking in the early visual pathway.

Understanding the retinal basis of vision across species

The vertebrate retina first evolved some 500 million years ago in ancestral marine chordates. Since then, the eyes of different species have been tuned to best support their unique visuoecological lifestyles. Visual specializations in eye designs, large-scale inhomogeneities across the retinal surface and local circuit motifs mean that all species' retinas are unique. Computational theories, such as the efficient coding hypothesis, have come a long way towards an explanation of the basic features of retinal organization and function; however, they cannot explain the full extent of retinal diversity within and across species. To build a truly general understanding of vertebrate vision and the retina's computational purpose, it is therefore important to more quantitatively relate different species' retinal functions to their specific natural environments and behavioural requirements. Ultimately, the goal of such efforts should be to build up to a more general theory of vision.

DeepBehavior: A Deep Learning Toolbox for Automated Analysis of Animal and Human Behavior Imaging Data

Detailed behavioral analysis is key to understanding the brain-behavior relationship. Here, we present deep learning-based methods for analysis of behavior imaging data in mice and humans. Specifically, we use three different convolutional neural network architectures and five different behavior tasks in mice and humans and provide detailed instructions for rapid implementation of these methods for the neuroscience community. We provide examples of three dimensional (3D) kinematic analysis in the food pellet reaching task in mice, three-chamber test in mice, social interaction test in freely moving mice with simultaneous miniscope calcium imaging, and 3D kinematic analysis of two upper extremity movements in humans (reaching and alternating pronation/supination). We demonstrate that the transfer learning approach accelerates the training of the network when using images from these types of behavior video recordings. We also provide code for post-processing of the data after initial analysis with deep learning. Our methods expand the repertoire of available tools using deep learning for behavior analysis by providing detailed instructions on implementation, applications in several behavior tests, and post-processing methods and annotated code for detailed behavior analysis. Moreover, our methods in human motor behavior can be used in the clinic to assess motor function during recovery after an injury such as stroke.

A dynamic network model of temporal receptive fields in primary auditory cortex

Auditory neurons encode stimulus history, which is often modelled using a span of time-delays in a spectro-temporal receptive field (STRF). We propose an alternative model for the encoding of stimulus history, which we apply to extracellular recordings of neurons in the primary auditory cortex of anaesthetized ferrets. For a linear-non-linear STRF model (LN model) to achieve a high level of performance in predicting single unit neural responses to natural sounds in the primary auditory cortex, we found that it is necessary to include time delays going back at least 200 ms in the past. This is an unrealistic time span for biological delay lines. We therefore asked how much of this dependence on stimulus history can instead be explained by dynamical aspects of neurons. We constructed a neural-network model whose output is the weighted sum of units whose responses are determined by a dynamic firing-rate equation. The dynamic aspect performs low-pass filtering on each unit's response, providing an exponentially decaying memory whose time constant is individual to each unit. We find that this dynamic network (DNet) model, when fitted to the neural data using STRFs of only 25 ms duration, can achieve prediction performance on a held-out dataset comparable to the best performing LN model with STRFs of 200 ms duration. These findings suggest that integration due to the membrane time constants or other exponentially-decaying memory processes may underlie linear temporal receptive fields of neurons beyond 25 ms.

Comparative Principles for Next-Generation Neuroscience

Neuroscience is enjoying a renaissance of discovery due in large part to the implementation of next-generation molecular technologies. The advent of genetically encoded tools has complemented existing methods and provided researchers the opportunity to examine the nervous system with unprecedented precision and to reveal facets of neural function at multiple scales. The weight of these discoveries, however, has been technique-driven from a small number of species amenable to the most advanced gene-editing technologies. To deepen interpretation and build on these breakthroughs, an understanding of nervous system evolution and diversity are critical. Evolutionary change integrates advantageous variants of features into lineages, but is also constrained by pre-existing organization and function. Ultimately, each species’ neural architecture comprises both properties that are species-specific and those that are retained and shared. Understanding the evolutionary history of a nervous system provides interpretive power when examining relationships between brain structure and function. The exceptional diversity of nervous systems and their unique or unusual features can also be leveraged to advance research by providing opportunities to ask new questions and interpret findings that are not accessible in individual species. As new genetic and molecular technologies are added to the experimental toolkits utilized in diverse taxa, the field is at a key juncture to revisit the significance of evolutionary and comparative approaches for next-generation neuroscience as a foundational framework for understanding fundamental principles of neural function.

Probabilistic Encoding Models for Multivariate Neural Data

A key problem in systems neuroscience is to characterize how populations of neurons encode information in their patterns of activity. An understanding of the encoding process is essential both for gaining insight into the origins of perception and for the development of brain-computer interfaces. However, this characterization is complicated by the highly variable nature of neural responses, and thus usually requires probabilistic methods for analysis. Drawing on techniques from statistical modeling and machine learning, we review recent methods for extracting important variables that quantitatively describe how sensory information is encoded in neural activity. In particular, we discuss methods for estimating receptive fields, modeling neural population dynamics, and inferring low dimensional latent structure from a population of neurons, in the context of both electrophysiology and calcium imaging data.

The dynamic receptive fields of retinal ganglion cells

Retinal ganglion cells (RGCs) were one of the first classes of sensory neurons to be described in terms of a receptive field (RF). Over the last six decades, our understanding of the diversity of RGC types and the nuances of their response properties has grown exponentially. We will review the current understanding of RGC RFs mostly from studies in mammals, but including work from other vertebrates as well. We will argue for a new paradigm that embraces the fluidity of RGC RFs with an eye toward the neuroethology of vision. Specifically, we will focus on (1) different methods for measuring RGC RFs, (2) RF models, (3) feature selectivity and the distinction between fluid and stable RF properties, and (4) ideas about the future of understanding RGC RFs.

Inferring hidden structure in multilayered neural circuits

A central challenge in sensory neuroscience involves understanding how neural circuits shape computations across cascaded cell layers. Here we attempt to reconstruct the response properties of experimentally unobserved neurons in the interior of a multilayered neural circuit, using cascaded linear-nonlinear (LN-LN) models. We combine non-smooth regularization with proximal consensus algorithms to overcome difficulties in fitting such models that arise from the high dimensionality of their parameter space. We apply this framework to retinal ganglion cell processing, learning LN-LN models of retinal circuitry consisting of thousands of parameters, using 40 minutes of responses to white noise. Our models demonstrate a 53% improvement in predicting ganglion cell spikes over classical linear-nonlinear (LN) models. Internal nonlinear subunits of the model match properties of retinal bipolar cells in both receptive field structure and number. Subunits have consistently high thresholds, supressing all but a small fraction of inputs, leading to sparse activity patterns in which only one subunit drives ganglion cell spiking at any time. From the model’s parameters, we predict that the removal of visual redundancies through stimulus decorrelation across space, a central tenet of efficient coding theory, originates primarily from bipolar cell synapses. Furthermore, the composite nonlinear computation performed by retinal circuitry corresponds to a boolean OR function applied to bipolar cell feature detectors. Our methods are statistically and computationally efficient, enabling us to rapidly learn hierarchical non-linear models as well as efficiently compute widely used descriptive statistics such as the spike triggered average (STA) and covariance (STC) for high dimensional stimuli. This general computational framework may aid in extracting principles of nonlinear hierarchical sensory processing across diverse modalities from limited data.

Computation in neural circuits arises from the cascaded processing of inputs through multiple cell layers. Each of these cell layers performs operations such as filtering and thresholding in order to shape a circuit’s output. It remains a challenge to describe both the computations and the mechanisms that mediate them given limited data recorded from a neural circuit. A standard approach to describing circuit computation involves building quantitative encoding models that predict the circuit response given its input, but these often fail to map in an interpretable way onto mechanisms within the circuit. In this work, we build two layer linear-nonlinear cascade models (LN-LN) in order to describe how the retinal output is shaped by nonlinear mechanisms in the inner retina. We find that these LN-LN models, fit to ganglion cell recordings alone, identify filters and nonlinearities that are readily mapped onto individual circuit components inside the retina, namely bipolar cells and the bipolar-to-ganglion cell synaptic threshold. This work demonstrates how combining simple prior knowledge of circuit properties with partial experimental recordings of a neural circuit’s output can yield interpretable models of the entire circuit computation, including parts of the circuit that are hidden or not directly observed in neural recordings.

Convis: A Toolbox to Fit and Simulate Filter-Based Models of Early Visual Processing

We developed Convis, a Python simulation toolbox for large scale neural populations which offers arbitrary receptive fields by 3D convolutions executed on a graphics card. The resulting software proves to be flexible and easily extensible in Python, while building on the PyTorch library (The Pytorch Project, 2017), which was previously used successfully in deep learning applications, for just-in-time optimization and compilation of the model onto CPU or GPU architectures. An alternative implementation based on Theano (Theano Development Team, 2016) is also available, although not fully supported. Through automatic differentiation, any parameter of a specified model can be optimized to approach a desired output which is a significant improvement over e.g., Monte Carlo or particle optimizations without gradients. We show that a number of models including even complex non-linearities such as contrast gain control and spiking mechanisms can be implemented easily. We show in this paper that we can in particular recreate the simulation results of a popular retina simulation software VirtualRetina (Wohrer and Kornprobst, 2009), with the added benefit of providing (1) arbitrary linear filters instead of the product of Gaussian and exponential filters and (2) optimization routines utilizing the gradients of the model. We demonstrate the utility of 3d convolution filters with a simple direction selective filter. Also we show that it is possible to optimize the input for a certain goal, rather than the parameters, which can aid the design of experiments as well as closed-loop online stimulus generation. Yet, Convis is more than a retina simulator. For instance it can also predict the response of V1 orientation selective cells. Convis is open source under the GPL-3.0 license and available from https://github.com/jahuth/convis/ with documentation at https://jahuth.github.io/convis/.

Diversity in spatial scope of contrast adaptation among mouse retinal ganglion cells

Retinal ganglion cells adapt to changes in visual contrast by adjusting their response kinetics and sensitivity. While much work has focused on the time scales of these adaptation processes, less is known about the spatial scale of contrast adaptation. For example, do small, localized contrast changes affect a cell's signal processing across its entire receptive field? Previous investigations have provided conflicting evidence, suggesting that contrast adaptation occurs either locally within subregions of a ganglion cell's receptive field or globally over the receptive field in its entirety. Here, we investigated the spatial extent of contrast adaptation in ganglion cells of the isolated mouse retina through multielectrode-array recordings. We applied visual stimuli so that ganglion cell receptive fields contained regions where the average contrast level changed periodically as well as regions with constant average contrast level. This allowed us to analyze temporal stimulus integration and sensitivity separately for stimulus regions with and without contrast changes. We found that the spatial scope of contrast adaptation depends strongly on cell identity, with some ganglion cells displaying clear local adaptation, whereas others, in particular large transient ganglion cells, adapted globally to contrast changes. Thus, the spatial scope of contrast adaptation in mouse retinal ganglion cells appears to be cell-type specific. This could reflect differences in mechanisms of contrast adaptation and may contribute to the functional diversity of different ganglion cell types.NEW & NOTEWORTHY Understanding whether adaptation of a neuron in a sensory system can occur locally inside the receptive field or whether it always globally affects the entire receptive field is important for understanding how the neuron processes complex sensory stimuli. For mouse retinal ganglion cells, we here show that both local and global contrast adaptation exist and that this diversity in spatial scope can contribute to the functional diversity of retinal ganglion cell types.

The Calcineurin-Binding, Activity-Dependent Splice Variant Dynamin1xb Is Highly Enriched in Synapses in Various Regions of the Central Nervous System

In the present study, we generated and characterized a splice site-specific monoclonal antibody that selectively detects the calcineurin-binding dynamin1 splice variant dynamin1xb. Calcineurin is a Ca²⁺-regulated phosphatase that enhances dynamin1 activity and is an important Ca²⁺-sensing mediator of homeostatic synaptic plasticity in neurons. Using this dynamin1xb-specific antibody, we found dynamin1xb highly enriched in synapses of all analyzed brain regions. In photoreceptor ribbon synapses, dynamin1xb was enriched in close vicinity to the synaptic ribbon in a manner indicative of a peri-active zone immunolabeling. Interestingly, in dark-adapted mice we observed an enhanced and selective enrichment of dynamin1xb in both synaptic layers of the retina in comparison to light-adapted mice. This could be due to an illumination-dependent recruitment of dynamin1xb to retinal synapses and/or due to a darkness-induced increase of dynamin1xb biosynthesis. These latter findings indicate that dynamin1xb is part of a versatile and highly adjustable, activity-regulated endocytic synaptic machinery.

Elevated IOP alters the space-time profiles in the center and surround of both ON and OFF RGCs in mouse

Glaucoma is a leading cause of blindness worldwide, and is characterized by progressive retinal ganglion cell (RGC) death. An experimental model of glaucoma has been established by elevating the intraocular pressure (IOP) via microbead occlusion of ocular fluid outflow in mice. Studies in this model have found visual dysfunction that varied with adaptational state, occurred before anatomical changes, and affected OFF RGCs more than ON RGCs. These results indicate subtle alterations in the underlying retinal circuitry that could help identify disease before irreversible RGC changes. Therefore, we looked at how RGC function was altered with elevated IOP under both photopic and scotopic conditions. We first found that responses to light offset are diminished with IOP elevation along with a concomitant decrease in receptive field center size for OFF RGCs. In addition, the antagonistic surround strength and size was reduced in ON RGCs. Furthermore, elevation of IOP significantly accelerated the photopic temporal tuning of RGC center responses in both ON and OFF RGCs. We found that some of the IOP-induced functional changes to OFF RGCs relied on ON cross-over pathways, indicating dysfunction in inner retinal circuitry. Overall, these results suggest that IOP alters multiple functions in the retina depending on the adaptational state. They provide a basis for designing multiple functional tests for early detection of glaucoma and for circuit-specific therapeutic targets in treatment of this blinding disease.

Inference of neuronal functional circuitry with spike-triggered non-negative matrix factorization

Neurons in sensory systems often pool inputs over arrays of presynaptic cells, giving rise to functional subunits inside a neuron’s receptive field. The organization of these subunits provides a signature of the neuron’s presynaptic functional connectivity and determines how the neuron integrates sensory stimuli. Here we introduce the method of spike-triggered non-negative matrix factorization for detecting the layout of subunits within a neuron’s receptive field. The method only requires the neuron’s spiking responses under finely structured sensory stimulation and is therefore applicable to large populations of simultaneously recorded neurons. Applied to recordings from ganglion cells in the salamander retina, the method retrieves the receptive fields of presynaptic bipolar cells, as verified by simultaneous bipolar and ganglion cell recordings. The identified subunit layouts allow improved predictions of ganglion cell responses to natural stimuli and reveal shared bipolar cell input into distinct types of ganglion cells.

How a neuron integrates sensory information requires knowledge about its functional presynaptic connections. Here the authors report a new method using non-negative matrix factorization to identify the layout of presynaptic bipolar cell inputs onto retinal ganglion cells and predict their responses to natural stimuli.