Cortical spatiotemporal dimensionality reduction for visual grouping

Functional architecture of M1 cells encoding movement direction

In this paper we propose a neurogeometrical model of the behaviour of cells of the arm area of the primary motor cortex (M1). We will mathematically express as a fiber bundle the hypercolumnar organization of this cortical area, first modelled by Georgopoulos (Georgopoulos et al., 1982; Georgopoulos, 2015). On this structure, we will consider the selective tuning of M1 neurons of kinematic variables of positions and directions of movement. We will then extend this model to encode the notion of fragments introduced by Hatsopoulos et al. (2007) which describes the selectivity of neurons to movement direction varying in time. This leads to consider a higher dimensional geometrical structure where fragments are represented as integral curves. A comparison with the curves obtained through numerical simulations and experimental data will be presented. Moreover, neural activity shows coherent behaviours represented in terms of movement trajectories pointing to a specific pattern of movement decomposition Kadmon Harpaz et al. (2019). Here, we will recover this pattern through a spectral clustering algorithm in the subriemannian structure we introduced, and compare our results with the neurophysiological one of Kadmon Harpaz et al. (2019).

Multi-Frequency Image Completion via a Biologically-Inspired Sub-Riemannian Model with Frequency and Phase

We present a novel cortically-inspired image completion algorithm. It uses five-dimensional sub-Riemannian cortical geometry, modeling the orientation, spatial frequency and phase-selective behavior of the cells in the visual cortex. The algorithm extracts the orientation, frequency and phase information existing in a given two-dimensional corrupted input image via a Gabor transform and represents those values in terms of cortical cell output responses in the model geometry. Then, it performs completion via a diffusion concentrated in a neighborhood along the neural connections within the model geometry. The diffusion models the activity propagation integrating orientation, frequency and phase features along the neural connections. Finally, the algorithm transforms the diffused and completed output responses back to the two-dimensional image plane.

A sub-Riemannian model of the visual cortex with frequency and phase

In this paper, we present a novel model of the primary visual cortex (V1) based on orientation, frequency, and phase selective behavior of V1 simple cells. We start from the first-level mechanisms of visual perception, receptive profiles. The model interprets V1 as a fiber bundle over the two-dimensional retinal plane by introducing orientation, frequency, and phase as intrinsic variables. Each receptive profile on the fiber is mathematically interpreted as rotated, frequency modulated, and phase shifted Gabor function. We start from the Gabor function and show that it induces in a natural way the model geometry and the associated horizontal connectivity modeling of the neural connectivity patterns in V1. We provide an image enhancement algorithm employing the model framework. The algorithm is capable of exploiting not only orientation but also frequency and phase information existing intrinsically in a two-dimensional input image. We provide the experimental results corresponding to the enhancement algorithm.

Curvature Integration in a 5D Kernel for Extracting Vessel Connections in Retinal Images

Tree-like structures, such as retinal images, are widely studied in computer-aided diagnosis systems for large-scale screening programs. Despite several segmentation and tracking methods proposed in the literature, there still exist several limitations specifically when two or more curvilinear structures cross or bifurcate, or in the presence of interrupted lines or highly curved blood vessels. In this paper, we propose a novel approach based on multi-orientation scores augmented with a contextual affinity matrix, which both are inspired by the geometry of the primary visual cortex (V1) and their contextual connections. The connectivity is described with a 5D kernel obtained as the fundamental solution of the Fokker-Planck equation modeling the cortical connectivity in the lifted space of positions, orientations, curvatures, and intensity. It is further used in a self-tuning spectral clustering step to identify the main perceptual units in the stimuli. The proposed method has been validated on several easy as well as challenging structures in a set of artificial images and actual retinal patches. Supported by quantitative and qualitative results, the method is capable of overcoming the limitations of current state-of-the-art techniques.

Local and Global Gestalt Laws: A Neurally Based Spectral Approach

This letter presents a mathematical model of figure-ground articulation that takes into account both local and global gestalt laws and is compatible with the functional architecture of the primary visual cortex (V1). The local gestalt law of good continuation is described by means of suitable connectivity kernels that are derived from Lie group theory and quantitatively compared with long-range connectivity in V1. Global gestalt constraints are then introduced in terms of spectral analysis of a connectivity matrix derived from these kernels. This analysis performs grouping of local features and individuates perceptual units with the highest salience. Numerical simulations are performed, and results are obtained by applying the technique to a number of stimuli.