A Computational Model of Innate Directional Selectivity Refined by Visual Experience

Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception

The combination of spiking neural networks and event-based vision sensors holds the potential of highly efficient and high-bandwidth optical flow estimation. This paper presents the first hierarchical spiking architecture in which motion (direction and speed) selectivity emerges in an unsupervised fashion from the raw stimuli generated with an event-based camera. A novel adaptive neuron model and stable spike-timing-dependent plasticity formulation are at the core of this neural network governing its spike-based processing and learning, respectively. After convergence, the neural architecture exhibits the main properties of biological visual motion systems, namely feature extraction and local and global motion perception. Convolutional layers with input synapses characterized by single and multiple transmission delays are employed for feature and local motion perception, respectively; while global motion selectivity emerges in a final fully-connected layer. The proposed solution is validated using synthetic and real event sequences. Along with this paper, we provide the cuSNN library, a framework that enables GPU-accelerated simulations of large-scale spiking neural networks. Source code and samples are available at https://github.com/tudelft/cuSNN.

Discrimination of Motion Direction in a Robot Using a Phenomenological Model of Synaptic Plasticity

Recognizing and tracking the direction of moving stimuli is crucial to the control of much animal behaviour. In this study, we examine whether a bio-inspired model of synaptic plasticity implemented in a robotic agent may allow the discrimination of motion direction of real-world stimuli. Starting with a well-established model of short-term synaptic plasticity (STP), we develop a microcircuit motif of spiking neurons capable of exhibiting preferential and nonpreferential responses to changes in the direction of an orientation stimulus in motion. While the robotic agent processes sensory inputs, the STP mechanism introduces direction-dependent changes in the synaptic connections of the microcircuit, resulting in a population of units that exhibit a typical cortical response property observed in primary visual cortex (V1), namely, direction selectivity. Visually evoked responses from the model are then compared to those observed in multielectrode recordings from V1 in anesthetized macaque monkeys, while sinusoidal gratings are displayed on a screen. Overall, the model highlights the role of STP as a complementary mechanism in explaining the direction selectivity and applies these insights in a physical robot as a method for validating important response characteristics observed in experimental data from V1, namely, direction selectivity.

Spiking Neurons Integrating Visual Stimuli Orientation and Direction Selectivity in a Robotic Context

Visual motion detection is essential for the survival of many species. The phenomenon includes several spatial properties, not fully understood at the level of a neural circuit. This paper proposes a computational model of a visual motion detector that integrates direction and orientation selectivity features. A recent experiment in the Drosophila model highlights that stimulus orientation influences the neural response of direction cells. However, this interaction and the significance at the behavioral level are currently unknown. As such, another objective of this article is to study the effect of merging these two visual processes when contextualized in a neuro-robotic model and an operant conditioning procedure. In this work, the learning task was solved using an artificial spiking neural network, acting as the brain controller for virtual and physical robots, showing a behavior modulation from the integration of both visual processes.

Cortical amplification models of experience-dependent development of selective columns and response sparsification

The development of direction-selective cortical columns requires visual experience, but the neural circuits and plasticity mechanisms that are responsible for this developmental transition are unknown. To gain insight into the mechanisms that could underlie experience-dependent increases in selectivity, we explored families of cortical amplifier models that enhance weakly biased feedforward signals. Here we focused exclusively on possible contributions of cortico-cortical connections and took feedforward input to be constant. We modeled pairs of interconnected columns that received equal and oppositely biased inputs. In a single-element model of cortical columns, we found two ways that cortical columns could receive biased feedforward input and exhibit strong but unselective responses to stimuli: 1) within-column recurrent excitatory connections could be strong enough to amplify both strong and weak feedforward input, or 2) columns that received differently biased inputs could have strong excitatory cross-connections that destroy selectivity. A Hebbian plasticity rule combined with simulated experience with stimuli weakened these strong cross-connections across cortical columns, allowing the individual columns to respond selectively to their biased inputs. In a model that included both excitatory and inhibitory neurons in each column, an additional means of obtaining selectivity through the cortical circuit was uncovered: cross-column suppression of inhibition-stabilized networks. When each column operated as an inhibition-stabilized network, cross-column excitation onto inhibitory neurons forced competition between the columns but in a manner that did not involve strong null-direction inhibition, consistent with experimental measurements of direction selectivity in visual cortex. Experimental predictions of these possible contributions of cortical circuits are discussed.NEW & NOTEWORTHY Sensory circuits are initially constructed via mechanisms that are independent of sensory experience, but later refinement requires experience. We constructed models of how circuits that receive biased feedforward inputs can be initially unselective and then be modified by experience and plasticity so that the resulting circuit exhibits increased selectivity. We propose that neighboring cortical columns may initially exhibit coupling that is too strong for selectivity. Experience-dependent mechanisms decrease this coupling so individual columns can exhibit selectivity.