Towards an embodied in vitro electrophysiology: the NeuroBIT project

An Overview of In Vitro Biological Neural Networks for Robot Intelligence

In vitro biological neural networks (BNNs) interconnected with robots, so-called BNN-based neurorobotic systems, can interact with the external world, so that they can present some preliminary intelligent behaviors, including learning, memory, robot control, etc. This work aims to provide a comprehensive overview of the intelligent behaviors presented by the BNN-based neurorobotic systems, with a particular focus on those related to robot intelligence. In this work, we first introduce the necessary biological background to understand the 2 characteristics of the BNNs: nonlinear computing capacity and network plasticity. Then, we describe the typical architecture of the BNN-based neurorobotic systems and outline the mainstream techniques to realize such an architecture from 2 aspects: from robots to BNNs and from BNNs to robots. Next, we separate the intelligent behaviors into 2 parts according to whether they rely solely on the computing capacity (computing capacity-dependent) or depend also on the network plasticity (network plasticity-dependent), which are then expounded respectively, with a focus on those related to the realization of robot intelligence. Finally, the development trends and challenges of the BNN-based neurorobotic systems are discussed.

A Novel Robot System Integrating Biological and Mechanical Intelligence Based on Dissociated Neural Network-Controlled Closed-Loop Environment

We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning). Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle) to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.

In vitro studies of neuronal networks and synaptic plasticity in invertebrates and in mammals using multielectrode arrays

Brain functions are strictly dependent on neural connections formed during development and modified during life. The cellular and molecular mechanisms underlying synaptogenesis and plastic changes involved in learning and memory have been analyzed in detail in simple animals such as invertebrates and in circuits of mammalian brains mainly by intracellular recordings of neuronal activity. In the last decades, the evolution of techniques such as microelectrode arrays (MEAs) that allow simultaneous, long-lasting, noninvasive, extracellular recordings from a large number of neurons has proven very useful to study long-term processes in neuronal networks in vivo and in vitro. In this work, we start off by briefly reviewing the microelectrode array technology and the optimization of the coupling between neurons and microtransducers to detect subthreshold synaptic signals. Then, we report MEA studies of circuit formation and activity in invertebrate models such as Lymnaea, Aplysia, and Helix. In the following sections, we analyze plasticity and connectivity in cultures of mammalian dissociated neurons, focusing on spontaneous activity and electrical stimulation. We conclude by discussing plasticity in closed-loop experiments.

Endogenous cholinergic tone modulates spontaneous network level neuronal activity in primary cortical cultures grown on multi-electrode arrays

BACKGROUND

Cortical cultures grown long-term on multi-electrode arrays (MEAs) are frequently and extensively used as models of cortical networks in studies of neuronal firing activity, neuropharmacology, toxicology and mechanisms underlying synaptic plasticity. However, in contrast to the predominantly asynchronous neuronal firing activity exhibited by intact cortex, electrophysiological activity of mature cortical cultures is dominated by spontaneous epileptiform-like global burst events which hinders their effective use in network-level studies, particularly for neurally-controlled animat ('artificial animal') applications. Thus, the identification of culture features that can be exploited to produce neuronal activity more representative of that seen in vivo could increase the utility and relevance of studies that employ these preparations. Acetylcholine has a recognised neuromodulatory role affecting excitability, rhythmicity, plasticity and information flow in vivo although its endogenous production by cortical cultures and subsequent functional influence upon neuronal excitability remains unknown.

RESULTS

Consequently, using MEA electrophysiological recording supported by immunohistochemical and RT-qPCR methods, we demonstrate for the first time, the presence of intrinsic cholinergic neurons and significant, endogenous cholinergic tone in cortical cultures with a characterisation of the muscarinic and nicotinic components that underlie modulation of spontaneous neuronal activity. We found that tonic muscarinic ACh receptor (mAChR) activation affects global excitability and burst event regularity in a culture age-dependent manner whilst, in contrast, tonic nicotinic ACh receptor (nAChR) activation can modulate burst duration and the proportion of spikes occurring within bursts in a spatio-temporal fashion.

CONCLUSIONS

We suggest that the presence of significant endogenous cholinergic tone in cortical cultures and the comparability of its modulatory effects to those seen in intact brain tissues support emerging, exploitable commonalities between in vivo and in vitro preparations. We conclude that experimental manipulation of endogenous cholinergic tone could offer a novel opportunity to improve the use of cortical cultures for studies of network-level mechanisms in a manner that remains largely consistent with its functional role.

A "spike-based" grammar underlies directional modification in network connectivity: effect on bursting activity and implications for bio-hybrids systems

Developed biological systems are endowed with the ability of interacting with the environment; they sense the external state and react to it by changing their own internal state. Many attempts have been made to build ‘hybrids’ with the ability of perceiving, modifying and reacting to external modifications. Investigation of the rules that govern network changes in a hybrid system may lead to finding effective methods for ‘programming’ the neural tissue toward a desired task. Here we show a new perspective in the use of cortical neuronal cultures from embryonic mouse as a working platform to study targeted synaptic modifications. Differently from the common timing-based methods applied in bio-hybrids robotics, here we evaluated the importance of endogenous spike timing in the information processing. We characterized the influence of a spike-patterned stimulus in determining changes in neuronal synchronization (connectivity strength and precision) of the evoked spiking and bursting activity in the network. We show that tailoring the stimulation pattern upon a neuronal spike timing induces the network to respond stronger and more precisely to the stimulation. Interestingly, the induced modifications are conveyed more consistently in the burst timing. This increase in strength and precision may be a key in the interaction of the network with the external world and may be used to induce directional changes in bio-hybrid systems.

Embodied artificial evolution: Artificial evolutionary systems in the 21st Century

Evolution is one of the major omnipresent powers in the universe that has been studied for about two centuries. Recent scientific and technical developments make it possible to make the transition from passively understanding to actively using evolutionary processes. Today this is possible in Evolutionary Computing, where human experimenters can design and manipulate all components of evolutionary processes in digital spaces. We argue that in the near future it will be possible to implement artificial evolutionary processes outside such imaginary spaces and make them physically embodied. In other words, we envision the "Evolution of Things", rather than just the evolution of digital objects, leading to a new field of Embodied Artificial Evolution (EAE). The main objective of this paper is to present a unifying vision in order to aid the development of this high potential research area. To this end, we introduce the notion of EAE, discuss a few examples and applications, and elaborate on the expected benefits as well as the grand challenges this developing field will have to address.

NETWORK DYNAMICS AND SYNCHRONOUS ACTIVITY IN CULTURED CORTICAL NEURONS

Neurons extracted from specific areas of the Central Nervous System (CNS), such as the hippocampus, the cortex and the spinal cord, can be cultured in vitro and coupled with a micro-electrode array (MEA) for months. After a few days, neurons connect each other with functionally active synapses, forming a random network and displaying spontaneous electrophysiological activity. In spite of their simplified level of organization, they represent an useful framework to study general information processing properties and specific basic learning mechanisms in the nervous system. These experimental preparations show patterns of collective rhythmic activity characterized by burst and spike firing. The patterns of electrophysiological activity may change as a consequence of external stimulation (i.e., chemical and/or electrical inputs) and by partly modifying the "randomness" of the network architecture (i.e., confining neuronal sub-populations in clusters with micro-machined barriers). In particular we investigated how the spontaneous rhythmic and synchronous activity can be modulated or drastically changed by focal electrical stimulation, pharmacological manipulation and network segregation. Our results show that burst firing and global synchronization can be enhanced or reduced; and that the degree of synchronous activity in the network can be characterized by simple parameters such as cross-correlation on burst events.

Connecting neurons to a mobile robot: an in vitro bidirectional neural interface

One of the key properties of intelligent behaviors is the capability to learn and adapt to changing environmental conditions. These features are the result of the continuous and intense interaction of the brain with the external world, mediated by the body. For this reason “embodiment” represents an innovative and very suitable experimental paradigm when studying the neural processes underlying learning new behaviors and adapting to unpredicted situations. To this purpose, we developed a novel bidirectional neural interface. We interconnected in vitro neurons, extracted from rat embryos and plated on a microelectrode array (MEA), to external devices, thus allowing real-time closed-loop interaction. The novelty of this experimental approach entails the necessity to explore different computational schemes and experimental hypotheses. In this paper, we present an open, scalable architecture, which allows fast prototyping of different modules and where coding and decoding schemes and different experimental configurations can be tested. This hybrid system can be used for studying the computational properties and information coding in biological neuronal networks with far-reaching implications for the future development of advanced neuroprostheses.

Shaping embodied neural networks for adaptive goal-directed behavior

The acts of learning and memory are thought to emerge from the modifications of synaptic connections between neurons, as guided by sensory feedback during behavior. However, much is unknown about how such synaptic processes can sculpt and are sculpted by neuronal population dynamics and an interaction with the environment. Here, we embodied a simulated network, inspired by dissociated cortical neuronal cultures, with an artificial animal (an animat) through a sensory-motor loop consisting of structured stimuli, detailed activity metrics incorporating spatial information, and an adaptive training algorithm that takes advantage of spike timing dependent plasticity. By using our design, we demonstrated that the network was capable of learning associations between multiple sensory inputs and motor outputs, and the animat was able to adapt to a new sensory mapping to restore its goal behavior: move toward and stay within a user-defined area. We further showed that successful learning required proper selections of stimuli to encode sensory inputs and a variety of training stimuli with adaptive selection contingent on the animat's behavior. We also found that an individual network had the flexibility to achieve different multi-task goals, and the same goal behavior could be exhibited with different sets of network synaptic strengths. While lacking the characteristic layered structure of in vivo cortical tissue, the biologically inspired simulated networks could tune their activity in behaviorally relevant manners, demonstrating that leaky integrate-and-fire neural networks have an innate ability to process information. This closed-loop hybrid system is a useful tool to study the network properties intermediating synaptic plasticity and behavioral adaptation. The training algorithm provides a stepping stone towards designing future control systems, whether with artificial neural networks or biological animats themselves.

The ability of a brain to learn has been studied at various levels. However, a large gap exists between behavioral studies of learning and memory and studies of cellular plasticity. In particular, much remains unknown about how cellular plasticity scales to affect network population dynamics. In previous studies, we have addressed this by growing mammalian brain cells in culture and creating a long-term, two-way interface between a cultured network and a robot or an artificial animal. Behavior and learning could now be observed in concert with the detailed and long-term electrophysiology. In this work, we used modeling/simulation of living cortical cultures to investigate the network's capability to learn goal-directed behavior. A biologically inspired simulated network was used to determine an effective closed-loop training algorithm, and the system successfully exhibited multi-task goal-directed adaptive behavior. The results suggest that even though lacking the characteristic layered structure of a brain, the network still could be functionally shaped and showed meaningful behavior. Knowledge gained from working with such closed-loop systems could influence the design of future artificial neural networks, more effective neuroprosthetics, and even the use of living networks themselves as a biologically based control system.

Dissociated cortical networks show spontaneously correlated activity patterns during in vitro development

In vitro cultured neuronal networks coupled to microelectrode arrays (MEAs) constitute a valuable experimental model for studying changes in the neuronal dynamics at different stages of development. After a few days in culture, neurons start to connect each other with functionally active synapses, forming a random network and displaying spontaneous electrophysiological activity. The patterns of collective rhythmic activity change in time spontaneously during in vitro development. Such activity-dependent modifications play a key role in the maturation of the network and reflect changes in the synaptic efficacy, fact widely recognized as a cellular basis of learning, memory and developmental plasticity. Getting advantage from the possibilities offered by the MEAs, the aim of our study is to analyze and characterize the natural changes in dynamics of the electrophysiological activity at different ages of the culture, identifying peculiar steps of the spontaneous evolution of the network. The main finding is that between the second and the third week of culture, the network completely changes its electrophysiological patterns, both in terms of spiking and bursting activity and in terms of cross-correlation between pairs of active channels. Then the maturation process can be characterized by two main phases: modulation and shaping in the synaptic functional connectivity of the network (within the first and second week) and general moderate correlated activity, spread over the entire network, with connections properly formed and stabilized (within the fourth and fifth week).

Encoding of time-varying stimuli in populations of cultured neurons

We wondered whether random populations of dissociated cultured cortical neurons, despite of their lack of structure and/or regional specialization, are capable of modulating their neural activity as the effect of a time-varying stimulation - a simulated 'sensory' afference. More specifically, we used localized low-frequency, non-periodic trains of stimuli to simulate sensory afferences, and asked how much information about the original trains of stimuli could be extracted from the neural activity recorded at the different sites. Furthermore, motivated by the results of studies performed both in vivo and in vitro on different preparations, which suggested that isolated spikes and bursts may play different roles in coding time-varying signals, we explored the amount of such 'sensory' information that could be associated to these different firing modes. Finally, we asked whether and how such 'sensory' information is transferred from the sites of stimulation (i.e., the 'sensory' areas), to the other regions of the neural populations. To do this we applied stimulus reconstruction techniques and information theoretic concepts that are typically used to investigate neural coding in sensory systems.Our main results are that (1) slow variations of the rate of stimulation are coded into isolated spikes and in the time of occurrence of bursts (but not in the bursts' temporal structure); (2) increasing the rate of stimulation has the effect of increasing the proportion of isolated spikes in the average evoked response and their importance in coding for the stimuli; and, (3) the ability to recover the time course of the pattern of stimulation is strongly related to the degree of functional connectivity between stimulation and recording sites. These observations parallel similar findings in intact nervous systems regarding the complementary roles of bursts and tonic spikes in encoding sensory information.Our results also have interesting implications in the field of neuro-robotic interfaces. In fact, the ability of populations of neurons to code information is a prerequisite for obtaining hybrid systems, in which neuronal populations are used to control external devices.

Investigating neuronal activity with planar microelectrode arrays: achievements and new perspectives

Neuronal networks underlie memory storage and information processing in the human brain, and ultimately participate in what Eccles referred to as "the creation of consciousness". Moreover, as physiological dysfunctions of neurons almost always translate into serious health issues, the study of the dynamics of neuronal networks has become a major avenue of research, as well as their response to pharmacological tampering. Planar microelectrode arrays represent a unique tool to investigate such dynamics and interferences, as they allow one to observe the activity of neuronal networks spread in both space and time. We will here review the major results obtained with microelectrode arrays and give an overview of the latest technological developments in the field, including our own efforts to develop the potential of this already powerful technology.