Vesicle and reaction-diffusion hybrid modeling with STEPS

Vesicles carry out many essential functions within cells through the processes of endocytosis, exocytosis, and passive and active transport. This includes transporting and delivering molecules between different parts of the cell, and storing and releasing neurotransmitters in neurons. To date, computational simulation of these key biological players has been rather limited and has not advanced at the same pace as other aspects of cell modeling, restricting the realism of computational models. We describe a general vesicle modeling tool that has been designed for wide application to a variety of cell models, implemented within our software STochastic Engine for Pathway Simulation (STEPS), a stochastic reaction-diffusion simulator that supports realistic reconstructions of cell tissue in tetrahedral meshes. The implementation is validated in an extensive test suite, parallel performance is demonstrated in a realistic synaptic bouton model, and example models are visualized in a Blender extension module.

Anti-Hebbian plasticity drives sequence learning in striatum

Spatio-temporal activity patterns have been observed in a variety of brain areas in spontaneous activity, prior to or during action, or in response to stimuli. Biological mechanisms endowing neurons with the ability to distinguish between different sequences remain largely unknown. Learning sequences of spikes raises multiple challenges, such as maintaining in memory spike history and discriminating partially overlapping sequences. Here, we show that anti-Hebbian spike-timing dependent plasticity (STDP), as observed at cortico-striatal synapses, can naturally lead to learning spike sequences. We design a spiking model of the striatal output neuron receiving spike patterns defined as sequential input from a fixed set of cortical neurons. We use a simple synaptic plasticity rule that combines anti-Hebbian STDP and non-associative potentiation for a subset of the presented patterns called rewarded patterns. We study the ability of striatal output neurons to discriminate rewarded from non-rewarded patterns by firing only after the presentation of a rewarded pattern. In particular, we show that two biological properties of striatal networks, spiking latency and collateral inhibition, contribute to an increase in accuracy, by allowing a better discrimination of partially overlapping sequences. These results suggest that anti-Hebbian STDP may serve as a biological substrate for learning sequences of spikes.

The impact of spike timing precision and spike emission reliability on decoding accuracy

Precisely timed and reliably emitted spikes are hypothesized to serve multiple functions, including improving the accuracy and reproducibility of encoding stimuli, memories, or behaviours across trials. When these spikes occur as a repeating sequence, they can be used to encode and decode a potential time series. Here, we show both analytically and in simulations that the error incurred in approximating a time series with precisely timed and reliably emitted spikes decreases linearly with the number of neurons or spikes used in the decoding. This was verified numerically with synthetically generated patterns of spikes. Further, we found that if spikes were imprecise in their timing, or unreliable in their emission, the error incurred in decoding with these spikes would be sub-linear. However, if the spike precision or spike reliability increased with network size, the error incurred in decoding a time-series with sequences of spikes would maintain a linear decrease with network size. The spike precision had to increase linearly with network size, while the probability of spike failure had to decrease with the square-root of the network size. Finally, we identified a candidate circuit to test this scaling relationship: the repeating sequences of spikes with sub-millisecond precision in area HVC (proper name) of the zebra finch. This scaling relationship can be tested using both neural data and song-spectrogram-based recordings while taking advantage of the natural fluctuation in HVC network size due to neurogenesis.

Simple synaptic modulations implement diverse novelty computations

Detecting novelty is ethologically useful for an organism's survival. Recent experiments characterize how different types of novelty over timescales from seconds to weeks are reflected in the activity of excitatory and inhibitory neuron types. Here, we introduce a learning mechanism, familiarity-modulated synapses (FMSs), consisting of multiplicative modulations dependent on presynaptic or pre/postsynaptic neuron activity. With FMSs, network responses that encode novelty emerge under unsupervised continual learning and minimal connectivity constraints. Implementing FMSs within an experimentally constrained model of a visual cortical circuit, we demonstrate the generalizability of FMSs by simultaneously fitting absolute, contextual, and omission novelty effects. Our model also reproduces functional diversity within cell subpopulations, leading to experimentally testable predictions about connectivity and synaptic dynamics that can produce both population-level novelty responses and heterogeneous individual neuron signals. Altogether, our findings demonstrate how simple plasticity mechanisms within a cortical circuit structure can produce qualitatively distinct and complex novelty responses.

RoboEM: automated 3D flight tracing for synaptic-resolution connectomics

Mapping neuronal networks from three-dimensional electron microscopy (3D-EM) data still poses substantial reconstruction challenges, in particular for thin axons. Currently available automated image segmentation methods require manual proofreading for many types of connectomic analysis. Here we introduce RoboEM, an artificial intelligence-based self-steering 3D 'flight' system trained to navigate along neurites using only 3D-EM data as input. Applied to 3D-EM data from mouse and human cortex, RoboEM substantially improves automated state-of-the-art segmentations and can replace manual proofreading for more complex connectomic analysis problems, yielding computational annotation cost for cortical connectomes about 400-fold lower than the cost of manual error correction.

Spike sorting with Kilosort4

Spike sorting is the computational process of extracting the firing times of single neurons from recordings of local electrical fields. This is an important but hard problem in neuroscience, made complicated by the nonstationarity of the recordings and the dense overlap in electrical fields between nearby neurons. To address the spike-sorting problem, we have been openly developing the Kilosort framework. Here we describe the various algorithmic steps introduced in different versions of Kilosort. We also report the development of Kilosort4, a version with substantially improved performance due to clustering algorithms inspired by graph-based approaches. To test the performance of Kilosort, we developed a realistic simulation framework that uses densely sampled electrical fields from real experiments to generate nonstationary spike waveforms and realistic noise. We found that nearly all versions of Kilosort outperformed other algorithms on a variety of simulated conditions and that Kilosort4 performed best in all cases, correctly identifying even neurons with low amplitudes and small spatial extents in high drift conditions.

brainlife.io: a decentralized and open-source cloud platform to support neuroscience research

Neuroscience is advancing standardization and tool development to support rigor and transparency. Consequently, data pipeline complexity has increased, hindering FAIR (findable, accessible, interoperable and reusable) access. brainlife.io was developed to democratize neuroimaging research. The platform provides data standardization, management, visualization and processing and automatically tracks the provenance history of thousands of data objects. Here, brainlife.io is described and evaluated for validity, reliability, reproducibility, replicability and scientific utility using four data modalities and 3,200 participants.

Duet synchronization interventions affect social interactions

Humans' complex behavior, such as speech, music, or dance, requires us to coordinate our actions with external sounds as well as with social partners. The presence of a partner can influence individuals' synchronization, and, in turn, social connection with the partner may depend on the degree of synchronization. We manipulated the synchronization quality in intervention conditions to address the causal relationship between observed temporal synchrony and perceived social interaction. Pairs of musician and nonmusician participants first performed a turn-taking task consisting of alternating which partner tapped their melody in synchrony with a metronome (each tap generated the next tone in the melody). In two intervention conditions, participants attempted to synchronize their melodies simultaneously with their partner, either with normal auditory feedback (normal feedback) or randomly placed delayed feedback on 25% of melodic tones (delayed feedback). After each intervention, the turn-taking condition was repeated, and participants completed a questionnaire about connectedness, relationship, and feeling of synchronization with their partner. Results showed that partners' mean asynchronies were more negative following the delayed feedback intervention. In addition, nonmusician partners' tapping variability was larger following the delayed feedback intervention when they had the delayed feedback intervention first. Ratings of connectedness, relationship, and feeling of synchronization with their partner were reduced for all participants after the delayed feedback Intervention. We modeled participants' synchronization performance in the post-intervention turn-taking conditions using delay-coupling oscillator models. Reductions in synchronization performance after delayed feedback intervention were reflected in reduced coupling strength. These findings suggest that turn-taking synchronization performance and social connectedness are altered following short interventions that disrupt synchronization with a partner.

Chaotic neural dynamics facilitate probabilistic computations through sampling

Cortical neurons exhibit highly variable responses over trials and time. Theoretical works posit that this variability arises potentially from chaotic network dynamics of recurrently connected neurons. Here, we demonstrate that chaotic neural dynamics, formed through synaptic learning, allow networks to perform sensory cue integration in a sampling-based implementation. We show that the emergent chaotic dynamics provide neural substrates for generating samples not only of a static variable but also of a dynamical trajectory, where generic recurrent networks acquire these abilities with a biologically plausible learning rule through trial and error. Furthermore, the networks generalize their experience in the stimulus-evoked samples to the inference without partial or all sensory information, which suggests a computational role of spontaneous activity as a representation of the priors as well as a tractable biological computation for marginal distributions. These findings suggest that chaotic neural dynamics may serve for the brain function as a Bayesian generative model.

Blind source separation of event-related potentials using a recurrent neural network

Event-related potentials (ERPs) are a superposition of electric potential differences generated by neurophysiological activity associated with psychophysical events. Spatiotemporal dissociation of these signal sources can supplement conventional ERP analysis and improve source localization. However, results from established source separation methods applied to ERPs can be challenging to interpret. Hence, we have developed a recurrent neural network (RNN) method for blind source separation. The RNN transforms input step pulse signals representing events into corresponding ERP difference waveforms. Source waveforms are obtained from penultimate layer units and scalp maps are obtained from feed-forward output layer weights that project these source waveforms onto EEG electrode amplitudes. An interpretable, sparse source representation is achieved by incorporating L1 regularization of signals obtained from the penultimate layer of the network during training. This RNN method was applied to four ERP difference waveforms (MMN, N170, N400, P3) from the open-access ERP CORE database, and independent component analysis (ICA) was applied to the same data for comparison. The RNN decomposed these ERPs into eleven spatially and temporally separate sources that were less noisy, tended to be more ERP-specific, and were less similar to each other than ICA-derived sources. The RNN sources also had less ambiguity between source waveform amplitude, scalp potential polarity, and equivalent current dipole orientation than ICA sources. In conclusion, the proposed RNN blind source separation method can be effectively applied to grand-average ERP difference waves and holds promise for further development as a computational model of event-related neural signals.

Multi-scale modelling of the epileptic brain: advantages of computational therapy exploration

Objective: Epilepsy is a complex disease spanning across multiple scales, from ion channels in neurons to neuronal circuits across the entire brain. Over the past decades, computational models have been used to describe the pathophysiological activity of the epileptic brain from different aspects. Traditionally, each computational model can aid in optimizing therapeutic interventions, therefore, providing a particular view to design strategies for treating epilepsy. As a result, most studies are concerned with generating specific models of the epileptic brain that can help us understand the certain machinery of the pathological state. Those specific models vary in complexity and biological accuracy, with system-level models often lacking biological details.Approach: Here, we review various types of computational model of epilepsy and discuss their potential for different therapeutic approaches and scenarios, including drug discovery, surgical strategies, brain stimulation, and seizure prediction. We propose that we need to consider an integrated approach with a unified modelling framework across multiple scales to understand the epileptic brain. Our proposal is based on the recent increase in computational power, which has opened up the possibility of unifying those specific epileptic models into simulations with an unprecedented level of detail.Main results: A multi-scale epilepsy model can bridge the gap between biologically detailed models, used to address molecular and cellular questions, and brain-wide models based on abstract models which can account for complex neurological and behavioural observations.Significance: With these efforts, we move toward the next generation of epileptic brain models capable of connecting cellular features, such as ion channel properties, with standard clinical measures such as seizure severity.

Prediction error processing and sharpening of expected information across the face-processing hierarchy

The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.

Complex networks approach to study comorbidities in patients with unruptured intracranial aneurysms

The role of complex network analysis in patients with diagnosis of unruptured intracranial aneurysm is unexplored. The objective of this study is to assess the applicability of this methodology in aneurysm patients. We retrospectively analyze comprehensive unbiased local digital data of a large number of patients treated for any reason between January 2004 and July 2019. We apply an age-cohort approach to a total of 628,831 patients and construct the diagnostic history of each patient-and include the information how old the patient was when diagnosed for the first time with each diagnosis coded according to International Classification of Diseases. For each cohort of age within a 10 year interval and for each gender, we construct a statistically validated comorbidity network and focused on crucial comorbidity links that the aneurysm code has to other disease codes within the whole network. For all cohorts of different age and gender, the analysis shows that 267 diagnose codes have nearest neighbour statistically validated links to unruptured aneurysm ICD code. Among the 267 comorbidities, 204 (76%) were found in patients aged from 40 to 69-years old. Patterns of connectivity with aneurysms were found for smoking, hypertension, chronic obstructive pulmonary disease, dyslipidemia, and mood disorders. A few uncommon connections are also detected in cohorts of female patients. Our study explored the applicability of network analysis and statistical validation in aneurysm observational study.

Diverse and asymmetric patterns of single-neuron projectome in regulating interhemispheric connectivity

The corpus callosum, historically considered primarily for homotopic connections, supports many heterotopic connections, indicating complex interhemispheric connectivity. Understanding this complexity is crucial yet challenging due to diverse cell-specific wiring patterns. Here, we utilized public AAV bulk tracing and single-neuron tracing data to delineate the anatomical connection patterns of mouse brains and conducted wide-field calcium imaging to assess functional connectivity across various brain states in male mice. The single-neuron data uncovered complex and dense interconnected patterns, particularly for interhemispheric-heterotopic connections. We proposed a metric "heterogeneity" to quantify the complexity of the connection patterns. Computational modeling of these patterns suggested that the heterogeneity of upstream projections impacted downstream homotopic functional connectivity. Furthermore, higher heterogeneity observed in interhemispheric-heterotopic projections would cause lower strength but higher stability in functional connectivity than their intrahemispheric counterparts. These findings were corroborated by our wide-field functional imaging data, underscoring the important role of heterotopic-projection heterogeneity in interhemispheric communication.

Stability of transcranial magnetic stimulation electroencephalogram evoked potentials in pediatric epilepsy

Transcranial magnetic stimulation paired with electroencephalography (TMS-EEG) can measure local excitability and functional connectivity. To address trial-to-trial variability, responses to multiple TMS pulses are recorded to obtain an average TMS evoked potential (TEP). Balancing adequate data acquisition to establish stable TEPs with feasible experimental duration is critical when applying TMS-EEG to clinical populations. Here we aim to investigate the minimum number of pulses (MNP) required to achieve stable TEPs in children with epilepsy. Eighteen children with Self-Limited Epilepsy with Centrotemporal Spikes, a common epilepsy arising from the motor cortices, underwent multiple 100-pulse blocks of TMS to both motor cortices over two days. TMS was applied at 120% of resting motor threshold (rMT) up to a maximum of 100% maximum stimulator output. The average of all 100 pulses was used as a "gold-standard" TEP to which we compared "candidate" TEPs obtained by averaging subsets of pulses. We defined TEP stability as the MNP needed to achieve a concordance correlation coefficient of 80% between the candidate and "gold-standard" TEP. We additionally assessed whether experimental or clinical factors affected TEP stability. Results show that stable TEPs can be derived from fewer than 100 pulses, a number typically used for designing TMS-EEG experiments. The early segment (15-80 ms) of the TEP was less stable than the later segment (80-350 ms). Global mean field amplitude derived from all channels was less stable than local TEP derived from channels overlying the stimulated site. TEP stability did not differ depending on stimulated hemisphere, block order, or antiseizure medication use, but was greater in older children. Stimulation administered with an intensity above the rMT yielded more stable local TEPs. Studies of TMS-EEG in pediatrics have been limited by the complexity of experimental set-up and time course. This study serves as a critical starting point, demonstrating the feasibility of designing efficient TMS-EEG studies that use a relatively small number of pulses to study pediatric epilepsy and potentially other pediatric groups.

The association between gray matter volume in the hippocampal subfield and antidepressant efficacy mediated by abnormal dynamic functional connectivity

An abnormality of structures and functions in the hippocampus may have a key role in the pathophysiology of major depressive disorder (MDD). However, it is unclear whether structure factors of the hippocampus effectively impact antidepressant responses by hippocampal functional activity in MDD patients. We collected longitudinal data from 36 MDD patients before and after a 3-month course of antidepressant pharmacotherapy. Additionally, we obtained baseline data from 43 healthy controls matched for sex and age. Using resting-state functional magnetic resonance imaging (rs-fMRI), we estimated the dynamic functional connectivity (dFC) of the hippocampal subregions using a sliding-window method. The gray matter volume was calculated using voxel-based morphometry (VBM). The results indicated that patients with MDD exhibited significantly lower dFC of the left rostral hippocampus (rHipp.L) with the right precentral gyrus, left superior temporal gyrus and left postcentral gyrus compared to healthy controls at baseline. In MDD patients, the dFC of the rHipp.L with right precentral gyrus at baseline was correlated with both the rHipp.L volume and HAMD remission rate, and also mediated the effects of the rHipp.L volume on antidepressant performance. Our findings suggested that the interaction between hippocampal structure and functional activity might affect antidepressant performance, which provided a novel insight into the hippocampus-related neurobiological mechanism of MDD.

ANTsX neuroimaging-derived structural phenotypes of UK Biobank

UK Biobank is a large-scale epidemiological resource for investigating prospective correlations between various lifestyle, environmental, and genetic factors with health and disease progression. In addition to individual subject information obtained through surveys and physical examinations, a comprehensive neuroimaging battery consisting of multiple modalities provides imaging-derived phenotypes (IDPs) that can serve as biomarkers in neuroscience research. In this study, we augment the existing set of UK Biobank neuroimaging structural IDPs, obtained from well-established software libraries such as FSL and FreeSurfer, with related measurements acquired through the Advanced Normalization Tools Ecosystem. This includes previously established cortical and subcortical measurements defined, in part, based on the Desikan-Killiany-Tourville atlas. Also included are morphological measurements from two recent developments: medial temporal lobe parcellation of hippocampal and extra-hippocampal regions in addition to cerebellum parcellation and thickness based on the Schmahmann anatomical labeling. Through predictive modeling, we assess the clinical utility of these IDP measurements, individually and in combination, using commonly studied phenotypic correlates including age, fluid intelligence, numeric memory, and several other sociodemographic variables. The predictive accuracy of these IDP-based models, in terms of root-mean-squared-error or area-under-the-curve for continuous and categorical variables, respectively, provides comparative insights between software libraries as well as potential clinical interpretability. Results demonstrate varied performance between package-based IDP sets and their combination, emphasizing the need for careful consideration in their selection and utilization.

Robust compression and detection of epileptiform patterns in ECoG using a real-time spiking neural network hardware framework

Interictal Epileptiform Discharges (IED) and High Frequency Oscillations (HFO) in intraoperative electrocorticography (ECoG) may guide the surgeon by delineating the epileptogenic zone. We designed a modular spiking neural network (SNN) in a mixed-signal neuromorphic device to process the ECoG in real-time. We exploit the variability of the inhomogeneous silicon neurons to achieve efficient sparse and decorrelated temporal signal encoding. We interface the full-custom SNN device to the BCI2000 real-time framework and configure the setup to detect HFO and IED co-occurring with HFO (IED-HFO). We validate the setup on pre-recorded data and obtain HFO rates that are concordant with a previously validated offline algorithm (Spearman's ρ = 0.75, p = 1e-4), achieving the same postsurgical seizure freedom predictions for all patients. In a remote on-line analysis, intraoperative ECoG recorded in Utrecht was compressed and transferred to Zurich for SNN processing and successful IED-HFO detection in real-time. These results further demonstrate how automated remote real-time detection may enable the use of HFO in clinical practice.

Fast learning without synaptic plasticity in spiking neural networks

Spiking neural networks are of high current interest, both from the perspective of modelling neural networks of the brain and for porting their fast learning capability and energy efficiency into neuromorphic hardware. But so far we have not been able to reproduce fast learning capabilities of the brain in spiking neural networks. Biological data suggest that a synergy of synaptic plasticity on a slow time scale with network dynamics on a faster time scale is responsible for fast learning capabilities of the brain. We show here that a suitable orchestration of this synergy between synaptic plasticity and network dynamics does in fact reproduce fast learning capabilities of generic recurrent networks of spiking neurons. This points to the important role of recurrent connections in spiking networks, since these are necessary for enabling salient network dynamics. We show more specifically that the proposed synergy enables synaptic weights to encode more general information such as priors and task structures, since moment-to-moment processing of new information can be delegated to the network dynamics.

A bicoherence approach to analyze multi-dimensional cross-frequency coupling in EEG/MEG data

We introduce a blockwise generalisation of the Antisymmetric Cross-Bicoherence (ACB), a statistical method based on bispectral analysis. The Multi-dimensional ACB (MACB) is an approach that aims at detecting quadratic lagged phase-interactions between vector time series in the frequency domain. Such a coupling can be empirically observed in functional neuroimaging data, e.g., in electro/magnetoencephalographic signals. MACB is invariant under orthogonal trasformations of the data, which makes it independent, e.g., on the choice of the physical coordinate system in the neuro-electromagnetic inverse procedure. In extensive synthetic experiments, we prove that MACB performance is significantly better than that obtained by ACB. Specifically, the shorter the data length, or the higher the dimension of the single data space, the larger the difference between the two methods.

Rhythmicity of neuronal oscillations delineates their cortical and spectral architecture

Neuronal oscillations are commonly analyzed with power spectral methods that quantify signal amplitude, but not rhythmicity or 'oscillatoriness' per se. Here we introduce a new approach, the phase-autocorrelation function (pACF), for the direct quantification of rhythmicity. We applied pACF to human intracerebral stereoelectroencephalography (SEEG) and magnetoencephalography (MEG) data and uncovered a spectrally and anatomically fine-grained cortical architecture in the rhythmicity of single- and multi-frequency neuronal oscillations. Evidencing the functional significance of rhythmicity, we found it to be a prerequisite for long-range synchronization in resting-state networks and to be dynamically modulated during event-related processing. We also extended the pACF approach to measure 'burstiness' of oscillatory processes and characterized regions with stable and bursty oscillations. These findings show that rhythmicity is double-dissociable from amplitude and constitutes a functionally relevant and dynamic characteristic of neuronal oscillations.

Optimal reaching subject to computational and physical constraints reveals structure of the sensorimotor control system

Optimal feedback control provides an abstract framework describing the architecture of the sensorimotor system without prescribing implementation details such as what coordinate system to use, how feedback is incorporated, or how to accommodate changing task complexity. We investigate how such details are determined by computational and physical constraints by creating a model of the upper limb sensorimotor system in which all connection weights between neurons, feedback, and muscles are unknown. By optimizing these parameters with respect to an objective function, we find that the model exhibits a preference for an intrinsic (joint angle) coordinate representation of inputs and feedback and learns to calculate a weighted feedforward and feedback error. We further show that complex reaches around obstacles can be achieved by augmenting our model with a path-planner based on via points. The path-planner revealed "avoidance" neurons that encode directions to reach around obstacles and "placement" neurons that make fine-tuned adjustments to via point placement. Our results demonstrate the surprising capability of computationally constrained systems and highlight interesting characteristics of the sensorimotor system.

Population coding of strategic variables during foraging in freely moving macaques

Until now, it has been difficult to examine the neural bases of foraging in naturalistic environments because previous approaches have relied on restrained animals performing trial-based foraging tasks. Here we allowed unrestrained monkeys to freely interact with concurrent reward options while we wirelessly recorded population activity in the dorsolateral prefrontal cortex. The animals decided when and where to forage based on whether their prediction of reward was fulfilled or violated. This prediction was not solely based on a history of reward delivery, but also on the understanding that waiting longer improves the chance of reward. The task variables were continuously represented in a subspace of the high-dimensional population activity, and this compressed representation predicted the animal's subsequent choices better than the true task variables and as well as the raw neural activity. Our results indicate that monkeys' foraging strategies are based on a cortical model of reward dynamics as animals freely explore their environment.

Lexical-Semantic Content, Not Syntactic Structure, Is the Main Contributor to ANN-Brain Similarity of fMRI Responses in the Language Network

Representations from artificial neural network (ANN) language models have been shown to predict human brain activity in the language network. To understand what aspects of linguistic stimuli contribute to ANN-to-brain similarity, we used an fMRI data set of responses to n = 627 naturalistic English sentences (Pereira et al., 2018) and systematically manipulated the stimuli for which ANN representations were extracted. In particular, we (i) perturbed sentences' word order, (ii) removed different subsets of words, or (iii) replaced sentences with other sentences of varying semantic similarity. We found that the lexical-semantic content of the sentence (largely carried by content words) rather than the sentence's syntactic form (conveyed via word order or function words) is primarily responsible for the ANN-to-brain similarity. In follow-up analyses, we found that perturbation manipulations that adversely affect brain predictivity also lead to more divergent representations in the ANN's embedding space and decrease the ANN's ability to predict upcoming tokens in those stimuli. Further, results are robust as to whether the mapping model is trained on intact or perturbed stimuli and whether the ANN sentence representations are conditioned on the same linguistic context that humans saw. The critical result-that lexical-semantic content is the main contributor to the similarity between ANN representations and neural ones-aligns with the idea that the goal of the human language system is to extract meaning from linguistic strings. Finally, this work highlights the strength of systematic experimental manipulations for evaluating how close we are to accurate and generalizable models of the human language network.

Computational Language Modeling and the Promise of In Silico Experimentation

Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.

Exploring Flip Flop memories and beyond: training Recurrent Neural Networks with key insights

Training neural networks to perform different tasks is relevant across various disciplines. In particular, Recurrent Neural Networks (RNNs) are of great interest in Computational Neuroscience. Open-source frameworks dedicated to Machine Learning, such as Tensorflow and Keras have produced significant changes in the development of technologies that we currently use. This work contributes by comprehensively investigating and describing the application of RNNs for temporal processing through a study of a 3-bit Flip Flop memory implementation. We delve into the entire modeling process, encompassing equations, task parametrization, and software development. The obtained networks are meticulously analyzed to elucidate dynamics, aided by an array of visualization and analysis tools. Moreover, the provided code is versatile enough to facilitate the modeling of diverse tasks and systems. Furthermore, we present how memory states can be efficiently stored in the vertices of a cube in the dimensionally reduced space, supplementing previous results with a distinct approach.

Non-homogenous axonal bouton distribution in whole-brain single-cell neuronal networks

We examined the distribution of pre-synaptic contacts in axons of mouse neurons and constructed whole-brain single-cell neuronal networks using an extensive dataset of 1,891 fully reconstructed neurons. We found that bouton locations were not homogeneous throughout the axon and among brain regions. As our algorithm was able to generate whole-brain single-cell connectivity matrices from full morphology reconstruction datasets, we further found that non-homogeneous bouton locations have a significant impact on network wiring, including degree distribution, triad census, and community structure. By perturbing neuronal morphology, we further explored the link between anatomical details and network topology. In our in silico exploration, we found that dendritic and axonal tree span would have the greatest impact on network wiring, followed by synaptic contact deletion. Our results suggest that neuroanatomical details must be carefully addressed in studies of whole-brain networks at the single-cell level.

Psilocybin enhances insightfulness in meditation: a perspective on the global topology of brain imaging during meditation

In this study, for the first time, we explored a dataset of functional magnetic resonance images collected during focused attention and open monitoring meditation before and after a five-day psilocybin-assisted meditation retreat using a recently established approach, based on the Mapper algorithm from topological data analysis. After generating subject-specific maps for two groups (psilocybin vs. placebo, 18 subjects/group) of experienced meditators, organizational principles were uncovered using graph topological tools, including the optimal transport (OT) distance, a geometrically rich measure of similarity between brain activity patterns. This revealed characteristics of the topology (i.e. shape) in space (i.e. abstract space of voxels) and time dimension of whole-brain activity patterns during different styles of meditation and psilocybin-induced alterations. Most interestingly, we found that (psilocybin-induced) positive derealization, which fosters insightfulness specifically when accompanied by enhanced open-monitoring meditation, was linked to the OT distance between open-monitoring and resting state. Our findings suggest that enhanced meta-awareness through meditation practice in experienced meditators combined with potential psilocybin-induced positive alterations in perception mediate insightfulness. Together, these findings provide a novel perspective on meditation and psychedelics that may reveal potential novel brain markers for positive synergistic effects between mindfulness practices and psilocybin.

Cerebellar state estimation enables resilient coupling across behavioural domains

Cerebellar computations are necessary for fine behavioural control and may rely on internal models for estimation of behaviourally relevant states. Here, we propose that the central cerebellar function is to estimate how states interact with each other, and to use these estimates to coordinates extra-cerebellar neuronal dynamics underpinning a range of interconnected behaviours. To support this claim, we describe a cerebellar model for state estimation that includes state interactions, and link this model with the neuronal architecture and dynamics observed empirically. This is formalised using the free energy principle, which provides a dual perspective on a system in terms of both the dynamics of its physical-in this case neuronal-states, and the inferential process they entail. As a demonstration of this proposal, we simulate cerebellar-dependent synchronisation of whisking and respiration, which are known to be tightly coupled in rodents, as well as limb and tail coordination during locomotion. In summary, we propose that the ubiquitous involvement of the cerebellum in behaviour arises from its central role in precisely coupling behavioural domains.

Spike synchrony as a measure of Gestalt structure

The function of spike synchrony is debatable: some researchers view it as a mechanism for binding perceptual features, others - as a byproduct of brain activity. We argue for an alternative computational role: synchrony can estimate the prior probability of incoming stimuli. In V1, this can be achieved by comparing input with previously acquired visual experience, which is encoded in plastic horizontal intracortical connections. V1 connectivity structure can encode the acquired visual experience in the form of its aggregate statistics. Since the aggregate statistics of natural images tend to follow the Gestalt principles, we can assume that V1 is more often exposed to Gestalt-like stimuli, and this is manifested in its connectivity structure. At the same time, the connectivity structure has an impact on spike synchrony in V1. We used a spiking model with V1-like connectivity to demonstrate that spike synchrony reflects the Gestalt structure of the stimulus. We conducted simulation experiments with three Gestalt laws: proximity, similarity, and continuity, and found substantial differences in firing synchrony for stimuli with varying degrees of Gestalt-likeness. This allows us to conclude that spike synchrony indeed reflects the Gestalt structure of the stimulus, which can be interpreted as a mechanism for prior probability estimation.

Fractional order memcapacitive neuromorphic elements reproduce and predict neuronal function

There is an increasing need to implement neuromorphic systems that are both energetically and computationally efficient. There is also great interest in using electric elements with memory, memelements, that can implement complex neuronal functions intrinsically. A feature not widely incorporated in neuromorphic systems is history-dependent action potential time adaptation which is widely seen in real cells. Previous theoretical work shows that power-law history dependent spike time adaptation, seen in several brain areas and species, can be modeled with fractional order differential equations. Here, we show that fractional order spiking neurons can be implemented using super-capacitors. The super-capacitors have fractional order derivative and memcapacitive properties. We implemented two circuits, a leaky integrate and fire and a Hodgkin-Huxley. Both circuits show power-law spiking time adaptation and optimal coding properties. The spiking dynamics reproduced previously published computer simulations. However, the fractional order Hodgkin-Huxley circuit showed novel dynamics consistent with criticality. We compared the responses of this circuit to recordings from neurons in the weakly-electric fish that have previously been shown to perform fractional order differentiation of their sensory input. The criticality seen in the circuit was confirmed in spontaneous recordings in the live fish. Furthermore, the circuit also predicted long-lasting stimulation that was also corroborated experimentally. Our work shows that fractional order memcapacitors provide intrinsic memory dependence that could allow implementation of computationally efficient neuromorphic devices. Memcapacitors are static elements that consume less energy than the most widely studied memristors, thus allowing the realization of energetically efficient neuromorphic devices.

Modeling brain network flexibility in networks of coupled oscillators: a feasibility study

Modeling the functionality of the human brain is a major goal in neuroscience for which many powerful methodologies have been developed over the last decade. The impact of working memory and the associated brain regions on the brain dynamics is of particular interest due to their connection with many functions and malfunctions in the brain. In this context, the concept of brain flexibility has been developed for the characterization of brain functionality. We discuss emergence of brain flexibility that is commonly measured by the identification of changes in the cluster structure of co-active brain regions. We provide evidence that brain flexibility can be modeled by a system of coupled FitzHugh-Nagumo oscillators where the network structure is obtained from human brain Diffusion Tensor Imaging (DTI). Additionally, we propose a straightforward and computationally efficient alternative macroscopic measure, which is derived from the Pearson distance of functional brain matrices. This metric exhibits similarities to the established patterns of brain template flexibility that have been observed in prior investigations. Furthermore, we explore the significance of the brain's network structure and the strength of connections between network nodes or brain regions associated with working memory in the observation of patterns in networks flexibility. This work enriches our understanding of the interplay between the structure and function of dynamic brain networks and proposes a modeling strategy to study brain flexibility.

Speech-induced suppression during natural dialogues

When engaged in a conversation, one receives auditory information from the other's speech but also from their own speech. However, this information is processed differently by an effect called Speech-Induced Suppression. Here, we studied brain representation of acoustic properties of speech in natural unscripted dialogues, using electroencephalography (EEG) and high-quality speech recordings from both participants. Using encoding techniques, we were able to reproduce a broad range of previous findings on listening to another's speech, and achieving even better performances when predicting EEG signal in this complex scenario. Furthermore, we found no response when listening to oneself, using different acoustic features (spectrogram, envelope, etc.) and frequency bands, evidencing a strong effect of SIS. The present work shows that this mechanism is present, and even stronger, during natural dialogues. Moreover, the methodology presented here opens the possibility of a deeper understanding of the related mechanisms in a wider range of contexts.

Subjective feelings associated with expectations and rewards during risky decision-making in impulse control disorder

Impulse Control Disorder (ICD) in Parkinson's disease is a behavioral addiction induced by dopaminergic therapies, but otherwise unclear etiology. The current study investigates the interaction of reward processing variables, dopaminergic therapy, and risky decision-making and subjective feelings in patients with versus without ICD. Patients with (n = 18) and without (n = 12) ICD performed a risky decision-making task both 'on' and 'off' standard-of-care dopaminergic therapies (the task was performed on 2 different days with the order of on and off visits randomized for each patient). During each trial of the task, participants choose between two options, a gamble or a certain reward, and reported how they felt about decision outcomes. Subjective feelings of 'pleasure' are differentially driven by expectations of possible outcomes in patients with, versus without ICD. While off medication, the influence of expectations about risky-decisions on subjective feelings is reduced in patients with ICD versus without ICD. While on medication, the influence of expected outcomes in patients with ICD versus without ICD becomes similar. Computational modeling of behavior supports the idea that latent decision-making factors drive subjective feelings in patients with Parkinson's disease and that ICD status is associated with a change in the relationship between factors associated with risky behavior and subjective feelings about the experienced outcomes. Our results also suggest that dopaminergic medications modulate the impact expectations have on the participants' subjective reports. Altogether our results suggest that expectations about risky decisions may be decoupled from subjective feelings in patients with ICD, and that dopaminergic medications may reengage these circuits and increase emotional reactivity in patients with ICD.

A generative model of memory construction and consolidation

Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.

Simulated Dopamine Modulation of a Neurorobotic Model of the Basal Ganglia

The vertebrate basal ganglia play an important role in action selection-the resolution of conflicts between alternative motor programs. The effective operation of basal ganglia circuitry is also known to rely on appropriate levels of the neurotransmitter dopamine. We investigated reducing or increasing the tonic level of simulated dopamine in a prior model of the basal ganglia integrated into a robot control architecture engaged in a foraging task inspired by animal behaviour. The main findings were that progressive reductions in the levels of simulated dopamine caused slowed behaviour and, at low levels, an inability to initiate movement. These states were partially relieved by increased salience levels (stronger sensory/motivational input). Conversely, increased simulated dopamine caused distortion of the robot's motor acts through partially expressed motor activity relating to losing actions. This could also lead to an increased frequency of behaviour switching. Levels of simulated dopamine that were either significantly lower or higher than baseline could cause a loss of behavioural integration, sometimes leaving the robot in a 'behavioral trap'. That some analogous traits are observed in animals and humans affected by dopamine dysregulation suggests that robotic models could prove useful in understanding the role of dopamine neurotransmission in basal ganglia function and dysfunction.

An Agent-Based Model to Reproduce the Boolean Logic Behaviour of Neuronal Self-Organised Communities through Pulse Delay Modulation and Generation of Logic Gates

The human brain is arguably the most complex "machine" to ever exist. Its detailed functioning is yet to be fully understood, let alone modelled. Neurological processes have logical signal-processing and biophysical aspects, and both affect the brain's structure, functioning and adaptation. Mathematical approaches based on both information and graph theory have been extensively used in an attempt to approximate its biological functioning, along with Artificial Intelligence frameworks inspired by its logical functioning. In this article, an approach to model some aspects of the brain learning and signal processing is presented, mimicking the metastability and backpropagation found in the real brain while also accounting for neuroplasticity. Several simulations are carried out with this model to demonstrate how dynamic neuroplasticity, neural inhibition and neuron migration can reshape the brain's logical connectivity to synchronise signal processing and obtain certain target latencies. This work showcases the importance of dynamic logical and biophysical remodelling in brain plasticity. Combining mathematical (agents, graph theory, topology and backpropagation) and biomedical ingredients (metastability, neuroplasticity and migration), these preliminary results prove complex brain phenomena can be reproduced-under pertinent simplifications-via affordable computations, which can be construed as a starting point for more ambitiously accurate simulations.

Evaluating the Bayesian causal inference model of intentional binding through computational modeling

Intentional binding refers to the subjective compression of the time interval between an action and its consequence. While intentional binding has been widely used as a proxy for the sense of agency, its underlying mechanism has been largely veiled. Bayesian causal inference (BCI) has gained attention as a potential explanation, but currently lacks sufficient empirical support. Thus, this study implemented various computational models to describe the possible mechanisms of intentional binding, fitted them to individual observed data, and quantitatively evaluated their performance. The BCI models successfully isolated the parameters that potentially contributed to intentional binding (i.e., causal belief and temporal prediction) and generally better explained an observer's time estimation than traditional models such as maximum likelihood estimation. The estimated parameter values suggested that the time compression resulted from an expectation that the actions would immediately cause sensory outcomes. Furthermore, I investigated the algorithm that realized this BCI and found probability-matching to be a plausible candidate; people might heuristically reconstruct event timing depending on causal uncertainty rather than optimally integrating causal and temporal posteriors. The evidence demonstrated the utility of computational modeling to investigate how humans infer the causal and temporal structures of events and individual differences in that process.

Latent-state and model-based learning in PTSD

Post-traumatic stress disorder (PTSD) is characterized by altered emotional and behavioral responding following a traumatic event. In this article, we review the concepts of latent-state and model-based learning (i.e., learning and inferring abstract task representations) and discuss their relevance for clinical and neuroscience models of PTSD. Recent data demonstrate evidence for brain and behavioral biases in these learning processes in PTSD. These new data potentially recast excessive fear towards trauma cues as a problem in learning and updating abstract task representations, as opposed to traditional conceptualizations focused on stimulus-specific learning. Biases in latent-state and model-based learning may also be a common mechanism targeted in common therapies for PTSD. We highlight key knowledge gaps that need to be addressed to further elaborate how latent-state learning and its associated neurocircuitry mechanisms function in PTSD and how to optimize treatments to target these processes.

The Hopf whole-brain model and its linear approximation

Whole-brain models have proven to be useful to understand the emergence of collective activity among neural populations or brain regions. These models combine connectivity matrices, or connectomes, with local node dynamics, noise, and, eventually, transmission delays. Multiple choices for the local dynamics have been proposed. Among them, nonlinear oscillators corresponding to a supercritical Hopf bifurcation have been used to link brain connectivity and collective phase and amplitude dynamics in different brain states. Here, we studied the linear fluctuations of this model to estimate its stationary statistics, i.e., the instantaneous and lagged covariances and the power spectral densities. This linear approximation-that holds in the case of heterogeneous parameters and time-delays-allows analytical estimation of the statistics and it can be used for fast parameter explorations to study changes in brain state, changes in brain activity due to alterations in structural connectivity, and modulations of parameter due to non-equilibrium dynamics.

Memory reports are biased by all relevant contents of working memory

Sensory input is inherently noisy while the world is inherently predictable. When multiple observations of the same object are available, integration of the available information necessarily increases the reliability of a world estimate. Optimal integration of multiple instances of sensory evidence has already been demonstrated during multisensory perception but could benefit unimodal perception as well. In the present study 330 participants observed a sequence of four orientations and were cued to report one of them. Reports were biased by all simultaneously memorized items that were similar and relevant to the target item, weighted by their reliability (signal-to-noise ratio). Orientations presented before and presented after the target biased report, demonstrating that the bias emerges in memory and not (exclusively) during perception or encoding. Only attended, task-relevant items biased report. We suggest that these results reflect how the visual system integrates information that is sampled from the same object at consecutive timepoints to promote perceptual stability and behavioural effectiveness in a dynamic world. We suggest that similar response biases, such as serial dependence, might be instances of a more general mechanism of working memory averaging. Data is available at https://osf.io/embcf/ .

Modular subgraphs in large-scale connectomes underpin spontaneous co-fluctuation events in mouse and human brains

Previous studies have adopted an edge-centric framework to study fine-scale network dynamics in human fMRI. To date, however, no studies have applied this framework to data collected from model organisms. Here, we analyze structural and functional imaging data from lightly anesthetized mice through an edge-centric lens. We find evidence of "bursty" dynamics and events - brief periods of high-amplitude network connectivity. Further, we show that on a per-frame basis events best explain static FC and can be divided into a series of hierarchically-related clusters. The co-fluctuation patterns associated with each cluster centroid link distinct anatomical areas and largely adhere to the boundaries of algorithmically detected functional brain systems. We then investigate the anatomical connectivity undergirding high-amplitude co-fluctuation patterns. We find that events induce modular bipartitions of the anatomical network of inter-areal axonal projections. Finally, we replicate these same findings in a human imaging dataset. In summary, this report recapitulates in a model organism many of the same phenomena observed in previously edge-centric analyses of human imaging data. However, unlike human subjects, the murine nervous system is amenable to invasive experimental perturbations. Thus, this study sets the stage for future investigation into the causal origins of fine-scale brain dynamics and high-amplitude co-fluctuations. Moreover, the cross-species consistency of the reported findings enhances the likelihood of future translation.

Latent representations in hippocampal network model co-evolve with behavioral exploration of task structure

To successfully learn real-life behavioral tasks, animals must pair actions or decisions to the task's complex structure, which can depend on abstract combinations of sensory stimuli and internal logic. The hippocampus is known to develop representations of this complex structure, forming a so-called "cognitive map". However, the precise biophysical mechanisms driving the emergence of task-relevant maps at the population level remain unclear. We propose a model in which plateau-based learning at the single cell level, combined with reinforcement learning in an agent, leads to latent representational structures codependently evolving with behavior in a task-specific manner. In agreement with recent experimental data, we show that the model successfully develops latent structures essential for task-solving (cue-dependent "splitters") while excluding irrelevant ones. Finally, our model makes testable predictions concerning the co-dependent interactions between split representations and split behavioral policy during their evolution.

On computational models of theory of mind and the imitative reinforcement learning in spiking neural networks

Theory of Mind is referred to the ability of inferring other's mental states, and it plays a crucial role in social cognition and learning. Biological evidences indicate that complex circuits are involved in this ability, including the mirror neuron system. The mirror neuron system influences imitation abilities and action understanding, leading to learn through observing others. To simulate this imitative learning behavior, a Theory-of-Mind-based Imitative Reinforcement Learning (ToM-based ImRL) framework is proposed. Employing the bio-inspired spiking neural networks and the mechanisms of the mirror neuron system, ToM-based ImRL is a bio-inspired computational model which enables an agent to effectively learn how to act in an interactive environment through observing an expert, inferring its goals, and imitating its behaviors. The aim of this paper is to review some computational attempts in modeling ToM and to explain the proposed ToM-based ImRL framework which is tested in the environment of River Raid game from Atari 2600 series.