Processing and classification of chemical data inspired by insect olfaction

Nonlinear high-activity neuronal excitation enhances odor discrimination

Discrimination between different signals is crucial for animals' survival. Inhibition that suppresses weak neural activity is crucial for pattern decorrelation. Our understanding of alternative mechanics that allow efficient signal classification remains incomplete. We show that Drosophila olfactory receptor neurons (ORNs) have numerous intraglomerular axo-axonal connections mediated by the G protein-coupled receptor (GPCR), muscarinic type B receptor (mAChR-B). Contrary to its usual inhibitory role, mAChR-B participates in ORN excitation. The excitatory effect of mAChR-B only occurs at high ORN firing rates. A computational model demonstrates that nonlinear intraglomerular or global excitation decorrelates the activity patterns of ORNs of different types and improves odor classification and discrimination, while acting in concert with the previously known inhibition. Indeed, knocking down mAChR-B led to increased correlation in odor-induced ORN activity, which was associated with impaired odor discrimination, as shown in behavioral experiments. Furthermore, knockdown (KD) of mAChR-B and the GABAergic GPCR, GABAB-R, has an additive behavioral effect, causing reduced odor discrimination relative to single-KD flies. Together, this study unravels a novel mechanism for neuronal pattern decorrelation, which is based on nonlinear intraglomerular excitation.

Gain modulation and odor concentration invariance in early olfactory networks

The broad receptive field of the olfactory receptors constitutes the basis of a combinatorial code that allows animals to detect and discriminate many more odorants than the actual number of receptor types that they express. One drawback is that high odor concentrations recruit lower affinity receptors which can lead to the perception of qualitatively different odors. Here we addressed the contribution that signal-processing in the antennal lobe makes to reduce concentration dependence in odor representation. By means of calcium imaging and pharmacological approach we describe the contribution that GABA receptors play in terms of the amplitude and temporal profiles of the signals that convey odor information from the antennal lobes to higher brain centers. We found that GABA reduces the amplitude of odor elicited signals and the number of glomeruli that are recruited in an odor-concentration-dependent manner. Blocking GABA receptors decreases the correlation among glomerular activity patterns elicited by different concentrations of the same odor. In addition, we built a realistic mathematical model of the antennal lobe that was used to test the viability of the proposed mechanisms and to evaluate the processing properties of the AL network under conditions that cannot be achieved in physiology experiments. Interestingly, even though based on a rather simple topology and cell interactions solely mediated by GABAergic lateral inhibitions, the AL model reproduced key features of the AL response upon different odor concentrations and provides plausible solutions for concentration invariant recognition of odors by artificial sensors.

Higher-order olfactory neurons in the lateral horn support odor valence and odor identity coding in Drosophila

Understanding neuronal representations of odor-evoked activities and their progressive transformation from the sensory level to higher brain centers features one of the major aims in olfactory neuroscience. Here, we investigated how odor information is transformed and represented in higher-order neurons of the lateral horn, one of the higher olfactory centers implicated in determining innate behavior, using Drosophila melanogaster. We focused on a subset of third-order glutamatergic lateral horn neurons (LHNs) and characterized their odor coding properties in relation to their presynaptic partner neurons, the projection neurons (PNs) by two-photon functional imaging. We show that odors evoke reproducible, stereotypic, and odor-specific response patterns in LHNs. Notably, odor-evoked responses in these neurons are valence-specific in a way that their response amplitude is positively correlated with innate odor preferences. We postulate that this valence-specific activity is the result of integrating inputs from multiple olfactory channels through second-order neurons. GRASP and micro-lesioning experiments provide evidence that glutamatergic LHNs obtain their major excitatory input from uniglomerular PNs, while they receive an odor-specific inhibition through inhibitory multiglomerular PNs. In summary, our study indicates that odor representations in glutamatergic LHNs encode hedonic valence and odor identity and primarily retain the odor coding properties of second-order neurons.

Gas Recognition in E-Nose System: A Review

Gas recognition is essential in an electronic nose (E-nose) system, which is responsible for recognizing multivariate responses obtained by gas sensors in various applications. Over the past decades, classical gas recognition approaches such as principal component analysis (PCA) have been widely applied in E-nose systems. In recent years, artificial neural network (ANN) has revolutionized the field of E-nose, especially spiking neural network (SNN). In this paper, we investigate recent gas recognition methods for E-nose, and compare and analyze them in terms of algorithms and hardware implementations. We find each classical gas recognition method has a relatively fixed framework and a few parameters, which makes it easy to be designed and perform well with limited gas samples, but weak in multi-gas recognition under noise. While ANN-based methods obtain better recognition accuracy with flexible architectures and lots of parameters. However, some ANNs are too complex to be implemented in portable E-nose systems, such as deep convolutional neural networks (CNNs). In contrast, SNN-based gas recognition methods achieve satisfying accuracy and recognize more types of gases, and could be implemented with energy-efficient hardware, which makes them a promising candidate in multi-gas identification.

Neuromorphic Engineering Needs Closed-Loop Benchmarks

Neuromorphic engineering aims to build (autonomous) systems by mimicking biological systems. It is motivated by the observation that biological organisms—from algae to primates—excel in sensing their environment, reacting promptly to their perils and opportunities. Furthermore, they do so more resiliently than our most advanced machines, at a fraction of the power consumption. It follows that the performance of neuromorphic systems should be evaluated in terms of real-time operation, power consumption, and resiliency to real-world perturbations and noise using task-relevant evaluation metrics. Yet, following in the footsteps of conventional machine learning, most neuromorphic benchmarks rely on recorded datasets that foster sensing accuracy as the primary measure for performance. Sensing accuracy is but an arbitrary proxy for the actual system's goal—taking a good decision in a timely manner. Moreover, static datasets hinder our ability to study and compare closed-loop sensing and control strategies that are central to survival for biological organisms. This article makes the case for a renewed focus on closed-loop benchmarks involving real-world tasks. Such benchmarks will be crucial in developing and progressing neuromorphic Intelligence. The shift towards dynamic real-world benchmarking tasks should usher in richer, more resilient, and robust artificially intelligent systems in the future.

Benchmarking Highly Parallel Hardware for Spiking Neural Networks in Robotics

Animal brains still outperform even the most performant machines with significantly lower speed. Nonetheless, impressive progress has been made in robotics in the areas of vision, motion- and path planning in the last decades. Brain-inspired Spiking Neural Networks (SNN) and the parallel hardware necessary to exploit their full potential have promising features for robotic application. Besides the most obvious platform for deploying SNN, brain-inspired neuromorphic hardware, Graphical Processing Units (GPU) are well capable of parallel computing as well. Libraries for generating CUDA-optimized code, like GeNN and affordable embedded systems make them an attractive alternative due to their low price and availability. While a few performance tests exist, there has been a lack of benchmarks targeting robotic applications. We compare the performance of a neural Wavefront algorithm as a representative of use cases in robotics on different hardware suitable for running SNN simulations. The SNN used for this benchmark is modeled in the simulator-independent declarative language PyNN, which allows using the same model for different simulator backends. Our emphasis is the comparison between Nest, running on serial CPU, SpiNNaker, as a representative of neuromorphic hardware, and an implementation in GeNN. Beyond that, we also investigate the differences of GeNN deployed to different hardware. A comparison between the different simulators and hardware is performed with regard to total simulation time, average energy consumption per run, and the length of the resulting path. We hope that the insights gained about performance details of parallel hardware solutions contribute to developing more efficient SNN implementations for robotics.

Data-science based analysis of perceptual spaces of odors in olfactory loss

Diminished sense of smell impairs the quality of life but olfactorily disabled people are hardly considered in measures of disability inclusion. We aimed to stratify perceptual characteristics and odors according to the extent to which they are perceived differently with reduced sense of smell, as a possible basis for creating olfactory experiences that are enjoyed in a similar way by subjects with normal or impaired olfactory function. In 146 subjects with normal or reduced olfactory function, perceptual characteristics (edibility, intensity, irritation, temperature, familiarity, hedonics, painfulness) were tested for four sets of 10 different odors each. Data were analyzed with (i) a projection based on principal component analysis and (ii) the training of a machine-learning algorithm in a 1000-fold cross-validated setting to distinguish between olfactory diagnosis based on odor property ratings. Both analytical approaches identified perceived intensity and familiarity with the odor as discriminating characteristics between olfactory diagnoses, while evoked pain sensation and perceived temperature were not discriminating, followed by edibility. Two disjoint sets of odors were identified, i.e., d = 4 “discriminating odors” with respect to olfactory diagnosis, including cis-3-hexenol, methyl salicylate, 1-butanol and cineole, and d = 7 “non-discriminating odors”, including benzyl acetate, heptanal, 4-ethyl-octanoic acid, methional, isobutyric acid, 4-decanolide and p-cresol. Different weightings of the perceptual properties of odors with normal or reduced sense of smell indicate possibilities to create sensory experiences such as food, meals or scents that by emphasizing trigeminal perceptions can be enjoyed by both normosmic and hyposmic individuals.

An unsupervised neuromorphic clustering algorithm

Brains perform complex tasks using a fraction of the power that would be required to do the same on a conventional computer. New neuromorphic hardware systems are now becoming widely available that are intended to emulate the more power efficient, highly parallel operation of brains. However, to use these systems in applications, we need "neuromorphic algorithms" that can run on them. Here we develop a spiking neural network model for neuromorphic hardware that uses spike timing-dependent plasticity and lateral inhibition to perform unsupervised clustering. With this model, time-invariant, rate-coded datasets can be mapped into a feature space with a specified resolution, i.e., number of clusters, using exclusively neuromorphic hardware. We developed and tested implementations on the SpiNNaker neuromorphic system and on GPUs using the GeNN framework. We show that our neuromorphic clustering algorithm achieves results comparable to those of conventional clustering algorithms such as self-organizing maps, neural gas or k-means clustering. We then combine it with a previously reported supervised neuromorphic classifier network to demonstrate its practical use as a neuromorphic preprocessing module.

Insect-inspired neuromorphic computing

The steady improvement in the performance of computing systems seen for many decades is levelling off as the miniaturization of semiconducting technology approaches the atomic limit, facing severe physical and technological issues. Neuromorphic computing is an emerging solution which makes use of silicon technology in a different way, inline with the computational principles observed in animal nervous systems. In this article, we argue that the nervous systems of insects in particular offer themselves as an ideal starting point for incorporation into realistic neuromorphic systems and review research in developing insect-inspired neuromorphic systems. We conclude with an exciting yet tangible vision of a full neuromorphic sensory-motor system where a liquid state machine modelling the function of the insect mushroom body links input to output and allows for amalgamation of the work discussed in a hierarchical framework of a full system inspired by the concept of how information flows through insects.

An Investigation into Spike-Based Neuromorphic Approaches for Artificial Olfactory Systems

The implementation of neuromorphic methods has delivered promising results for vision and auditory sensors. These methods focus on mimicking the neuro-biological architecture to generate and process spike-based information with minimal power consumption. With increasing interest in developing low-power and robust chemical sensors, the application of neuromorphic engineering concepts for electronic noses has provided an impetus for research focusing on improving these instruments. While conventional e-noses apply computationally expensive and power-consuming data-processing strategies, neuromorphic olfactory sensors implement the biological olfaction principles found in humans and insects to simplify the handling of multivariate sensory data by generating and processing spike-based information. Over the last decade, research on neuromorphic olfaction has established the capability of these sensors to tackle problems that plague the current e-nose implementations such as drift, response time, portability, power consumption and size. This article brings together the key contributions in neuromorphic olfaction and identifies future research directions to develop near-real-time olfactory sensors that can be implemented for a range of applications such as biosecurity and environmental monitoring. Furthermore, we aim to expose the computational parallels between neuromorphic olfaction and gustation for future research focusing on the correlation of these senses.

Olfactory learning without the mushroom bodies: Spiking neural network models of the honeybee lateral antennal lobe tract reveal its capacities in odour memory tasks of varied complexities

The honeybee olfactory system is a well-established model for understanding functional mechanisms of learning and memory. Olfactory stimuli are first processed in the antennal lobe, and then transferred to the mushroom body and lateral horn through dual pathways termed medial and lateral antennal lobe tracts (m-ALT and l-ALT). Recent studies reported that honeybees can perform elemental learning by associating an odour with a reward signal even after lesions in m-ALT or blocking the mushroom bodies. To test the hypothesis that the lateral pathway (l-ALT) is sufficient for elemental learning, we modelled local computation within glomeruli in antennal lobes with axons of projection neurons connecting to a decision neuron (LHN) in the lateral horn. We show that inhibitory spike-timing dependent plasticity (modelling non-associative plasticity by exposure to different stimuli) in the synapses from local neurons to projection neurons decorrelates the projection neurons' outputs. The strength of the decorrelations is regulated by global inhibitory feedback within antennal lobes to the projection neurons. By additionally modelling octopaminergic modification of synaptic plasticity among local neurons in the antennal lobes and projection neurons to LHN connections, the model can discriminate and generalize olfactory stimuli. Although positive patterning can be accounted for by the l-ALT model, negative patterning requires further processing and mushroom body circuits. Thus, our model explains several-but not all-types of associative olfactory learning and generalization by a few neural layers of odour processing in the l-ALT. As an outcome of the combination between non-associative and associative learning, the modelling approach allows us to link changes in structural organization of honeybees' antennal lobes with their behavioural performances over the course of their life.

Hybrid Network Model for "Deep Learning" of Chemical Data: Application to Antimicrobial Peptides

We present a "deep" network architecture for chemical data analysis and classification together with a prospective proof-of-concept application. The model features a self-organizing map (SOM) as the input layer of a feedforward neural network. The SOM converts molecular descriptors to a two-dimensional image for further processing. We implemented lateral neuron inhibition for contrast enhancement. The model achieved improved classification accuracy and predictive robustness compared to feedforward network classifiers lacking the SOM layer. By nonlinear dimensionality reduction the networks extracted meaningful chemical features from the data and outperformed linear principal component analysis (PCA). The learning machine was trained on the sequence-length independent recognition of antibacterial peptides and correctly predicted the killing activity of a synthetic test peptide against Staphylococcus aureus in an in vitro experiment.

Comparing Neuromorphic Solutions in Action: Implementing a Bio-Inspired Solution to a Benchmark Classification Task on Three Parallel-Computing Platforms

Neuromorphic computing employs models of neuronal circuits to solve computing problems. Neuromorphic hardware systems are now becoming more widely available and "neuromorphic algorithms" are being developed. As they are maturing toward deployment in general research environments, it becomes important to assess and compare them in the context of the applications they are meant to solve. This should encompass not just task performance, but also ease of implementation, speed of processing, scalability, and power efficiency. Here, we report our practical experience of implementing a bio-inspired, spiking network for multivariate classification on three different platforms: the hybrid digital/analog Spikey system, the digital spike-based SpiNNaker system, and GeNN, a meta-compiler for parallel GPU hardware. We assess performance using a standard hand-written digit classification task. We found that whilst a different implementation approach was required for each platform, classification performances remained in line. This suggests that all three implementations were able to exercise the model's ability to solve the task rather than exposing inherent platform limits, although differences emerged when capacity was approached. With respect to execution speed and power consumption, we found that for each platform a large fraction of the computing time was spent outside of the neuromorphic device, on the host machine. Time was spent in a range of combinations of preparing the model, encoding suitable input spiking data, shifting data, and decoding spike-encoded results. This is also where a large proportion of the total power was consumed, most markedly for the SpiNNaker and Spikey systems. We conclude that the simulation efficiency advantage of the assessed specialized hardware systems is easily lost in excessive host-device communication, or non-neuronal parts of the computation. These results emphasize the need to optimize the host-device communication architecture for scalability, maximum throughput, and minimum latency. Moreover, our results indicate that special attention should be paid to minimize host-device communication when designing and implementing networks for efficient neuromorphic computing.

Understanding the Odour Spaces: A Step towards Solving Olfactory Stimulus-Percept Problem

Odours are highly complex, relying on hundreds of receptors, and people are known to disagree in their linguistic descriptions of smells. It is partly due to these facts that, it is very hard to map the domain of odour molecules or their structure to that of perceptual representations, a problem that has been referred to as the Structure-Odour-Relationship. We collected a number of diverse open domain databases of odour molecules having unorganised perceptual descriptors, and developed a graphical method to find the similarity between perceptual descriptors; which is intuitive and can be used to identify perceptual classes. We then separately projected the physico-chemical and perceptual features of these molecules in a non-linear dimension and clustered the similar molecules. We found a significant overlap between the spatial positioning of the clustered molecules in the physico-chemical and perceptual spaces. We also developed a statistical method of predicting the perceptual qualities of a novel molecule using its physico-chemical properties with high receiver operating characteristics(ROC).

Computational models to understand decision making and pattern recognition in the insect brain

Odor stimuli reaching olfactory systems of mammals and insects are characterized by remarkable non-stationary and noisy time series. Their brains have evolved to discriminate subtle changes in odor mixtures and find meaningful variations in complex spatio-temporal patterns. Insects with small brains can effectively solve two computational tasks: identify the presence of an odor type and estimate the concentration levels of the odor. Understanding the learning and decision making processes in the insect brain can not only help us to uncover general principles of information processing in the brain, but it can also provide key insights to artificial chemical sensing. Both olfactory learning and memory are dominantly organized in the Antennal Lobe (AL) and the Mushroom Bodies (MBs). Current computational models yet fail to deliver an integrated picture of the joint computational roles of the AL and MBs. This review intends to provide an integrative overview of the computational literature analyzed in the context of the problem of classification (odor discrimination) and regression (odor concentration estimation), particularly identifying key computational ingredients necessary to solve pattern recognition.

A spiking neural network model of self-organized pattern recognition in the early mammalian olfactory system

Olfactory sensory information passes through several processing stages before an odor percept emerges. The question how the olfactory system learns to create odor representations linking those different levels and how it learns to connect and discriminate between them is largely unresolved. We present a large-scale network model with single and multi-compartmental Hodgkin-Huxley type model neurons representing olfactory receptor neurons (ORNs) in the epithelium, periglomerular cells, mitral/tufted cells and granule cells in the olfactory bulb (OB), and three types of cortical cells in the piriform cortex (PC). Odor patterns are calculated based on affinities between ORNs and odor stimuli derived from physico-chemical descriptors of behaviorally relevant real-world odorants. The properties of ORNs were tuned to show saturated response curves with increasing concentration as seen in experiments. On the level of the OB we explored the possibility of using a fuzzy concentration interval code, which was implemented through dendro-dendritic inhibition leading to winner-take-all like dynamics between mitral/tufted cells belonging to the same glomerulus. The connectivity from mitral/tufted cells to PC neurons was self-organized from a mutual information measure and by using a competitive Hebbian-Bayesian learning algorithm based on the response patterns of mitral/tufted cells to different odors yielding a distributed feed-forward projection to the PC. The PC was implemented as a modular attractor network with a recurrent connectivity that was likewise organized through Hebbian-Bayesian learning. We demonstrate the functionality of the model in a one-sniff-learning and recognition task on a set of 50 odorants. Furthermore, we study its robustness against noise on the receptor level and its ability to perform concentration invariant odor recognition. Moreover, we investigate the pattern completion capabilities of the system and rivalry dynamics for odor mixtures.

A neuromorphic network for generic multivariate data classification

Computational neuroscience has uncovered a number of computational principles used by nervous systems. At the same time, neuromorphic hardware has matured to a state where fast silicon implementations of complex neural networks have become feasible. En route to future technical applications of neuromorphic computing the current challenge lies in the identification and implementation of functional brain algorithms. Taking inspiration from the olfactory system of insects, we constructed a spiking neural network for the classification of multivariate data, a common problem in signal and data analysis. In this model, real-valued multivariate data are converted into spike trains using "virtual receptors" (VRs). Their output is processed by lateral inhibition and drives a winner-take-all circuit that supports supervised learning. VRs are conveniently implemented in software, whereas the lateral inhibition and classification stages run on accelerated neuromorphic hardware. When trained and tested on real-world datasets, we find that the classification performance is on par with a naïve Bayes classifier. An analysis of the network dynamics shows that stable decisions in output neuron populations are reached within less than 100 ms of biological time, matching the time-to-decision reported for the insect nervous system. Through leveraging a population code, the network tolerates the variability of neuronal transfer functions and trial-to-trial variation that is inevitably present on the hardware system. Our work provides a proof of principle for the successful implementation of a functional spiking neural network on a configurable neuromorphic hardware system that can readily be applied to real-world computing problems.

Promising Aedes aegypti repellent chemotypes identified through integrated QSAR, virtual screening, synthesis, and bioassay

Molecular field topology analysis, scaffold hopping, and molecular docking were used as complementary computational tools for the design of repellents for Aedes aegypti, the insect vector for yellow fever, chikungunya, and dengue fever. A large number of analogues were evaluated by virtual screening with Glide molecular docking software. This produced several dozen hits that were either synthesized or procured from commercial sources. Analysis of these compounds by a repellent bioassay resulted in a few highly active chemicals (in terms of minimum effective dosage) as viable candidates for further hit-to-lead and lead optimization effort.

Local interneurons and projection neurons in the antennal lobe from a spiking point of view

Local computation in microcircuits is an essential feature of distributed information processing in vertebrate and invertebrate brains. The insect antennal lobe represents a spatially confined local network that processes high-dimensional and redundant peripheral input to compute an efficient odor code. Social insects can rely on a particularly rich olfactory receptor repertoire, and they exhibit complex odor-guided behaviors. This corresponds with a high anatomical complexity of their antennal lobe network. In the honeybee, a large number of glomeruli that receive sensory input are interconnected by a dense network of local interneurons (LNs). Uniglomerular projection neurons (PNs) integrate sensory and recurrent local network input into an efficient spatio-temporal odor code. To investigate the specific computational roles of LNs and PNs, we measured several features of sub- and suprathreshold single-cell responses to in vivo odor stimulation. Using a semisupervised cluster analysis, we identified a combination of five characteristic features as sufficient to separate LNs and PNs from each other, independent of the applied odor-stimuli. The two clusters differed significantly in all these five features. PNs showed a higher spontaneous subthreshold activation, assumed higher peak response rates and a more regular spiking pattern. LNs reacted considerably faster to the onset of a stimulus, and their responses were more reliable across stimulus repetitions. We discuss possible mechanisms that can explain our results, and we interpret cell-type-specific characteristics with respect to their functional relevance.

Mixture and odorant processing in the olfactory systems of insects: a comparative perspective

Natural olfactory stimuli are often complex mixtures of volatiles, of which the identities and ratios of constituents are important for odor-mediated behaviors. Despite this importance, the mechanism by which the olfactory system processes this complex information remains an area of active study. In this review, we describe recent progress in how odorants and mixtures are processed in the brain of insects. We use a comparative approach toward contrasting olfactory coding and the behavioral efficacy of mixtures in different insect species, and organize these topics around four sections: (1) Examples of the behavioral efficacy of odor mixtures and the olfactory environment; (2) mixture processing in the periphery; (3) mixture coding in the antennal lobe; and (4) evolutionary implications and adaptations for olfactory processing. We also include pertinent background information about the processing of individual odorants and comparative differences in wiring and anatomy, as these topics have been richly investigated and inform the processing of mixtures in the insect olfactory system. Finally, we describe exciting studies that have begun to elucidate the role of the processing of complex olfactory information in evolution and speciation.

Parallel processing in the honeybee olfactory pathway: structure, function, and evolution

Animals face highly complex and dynamic olfactory stimuli in their natural environments, which require fast and reliable olfactory processing. Parallel processing is a common principle of sensory systems supporting this task, for example in visual and auditory systems, but its role in olfaction remained unclear. Studies in the honeybee focused on a dual olfactory pathway. Two sets of projection neurons connect glomeruli in two antennal-lobe hemilobes via lateral and medial tracts in opposite sequence with the mushroom bodies and lateral horn. Comparative studies suggest that this dual-tract circuit represents a unique adaptation in Hymenoptera. Imaging studies indicate that glomeruli in both hemilobes receive redundant sensory input. Recent simultaneous multi-unit recordings from projection neurons of both tracts revealed widely overlapping response profiles strongly indicating parallel olfactory processing. Whereas lateral-tract neurons respond fast with broad (generalistic) profiles, medial-tract neurons are odorant specific and respond slower. In analogy to “what-” and “where” subsystems in visual pathways, this suggests two parallel olfactory subsystems providing “what-” (quality) and “when” (temporal) information. Temporal response properties may support across-tract coincidence coding in higher centers. Parallel olfactory processing likely enhances perception of complex odorant mixtures to decode the diverse and dynamic olfactory world of a social insect.

Parallel processing via a dual olfactory pathway in the honeybee

In their natural environment, animals face complex and highly dynamic olfactory input. Thus vertebrates as well as invertebrates require fast and reliable processing of olfactory information. Parallel processing has been shown to improve processing speed and power in other sensory systems and is characterized by extraction of different stimulus parameters along parallel sensory information streams. Honeybees possess an elaborate olfactory system with unique neuronal architecture: a dual olfactory pathway comprising a medial projection-neuron (PN) antennal lobe (AL) protocerebral output tract (m-APT) and a lateral PN AL output tract (l-APT) connecting the olfactory lobes with higher-order brain centers. We asked whether this neuronal architecture serves parallel processing and employed a novel technique for simultaneous multiunit recordings from both tracts. The results revealed response profiles from a high number of PNs of both tracts to floral, pheromonal, and biologically relevant odor mixtures tested over multiple trials. PNs from both tracts responded to all tested odors, but with different characteristics indicating parallel processing of similar odors. Both PN tracts were activated by widely overlapping response profiles, which is a requirement for parallel processing. The l-APT PNs had broad response profiles suggesting generalized coding properties, whereas the responses of m-APT PNs were comparatively weaker and less frequent, indicating higher odor specificity. Comparison of response latencies within and across tracts revealed odor-dependent latencies. We suggest that parallel processing via the honeybee dual olfactory pathway provides enhanced odor processing capabilities serving sophisticated odor perception and olfactory demands associated with a complex olfactory world of this social insect.

Six networks on a universal neuromorphic computing substrate

In this study, we present a highly configurable neuromorphic computing substrate and use it for emulating several types of neural networks. At the heart of this system lies a mixed-signal chip, with analog implementations of neurons and synapses and digital transmission of action potentials. Major advantages of this emulation device, which has been explicitly designed as a universal neural network emulator, are its inherent parallelism and high acceleration factor compared to conventional computers. Its configurability allows the realization of almost arbitrary network topologies and the use of widely varied neuronal and synaptic parameters. Fixed-pattern noise inherent to analog circuitry is reduced by calibration routines. An integrated development environment allows neuroscientists to operate the device without any prior knowledge of neuromorphic circuit design. As a showcase for the capabilities of the system, we describe the successful emulation of six different neural networks which cover a broad spectrum of both structure and functionality.

Exploring chemical space for drug discovery using the chemical universe database

Herein we review our recent efforts in searching for bioactive ligands by enumeration and virtual screening of the unknown chemical space of small molecules. Enumeration from first principles shows that almost all small molecules (>99.9%) have never been synthesized and are still available to be prepared and tested. We discuss open access sources of molecules, the classification and representation of chemical space using molecular quantum numbers (MQN), its exhaustive enumeration in form of the chemical universe generated databases (GDB), and examples of using these databases for prospective drug discovery. MQN-searchable GDB, PubChem, and DrugBank are freely accessible at www.gdb.unibe.ch.

Olfactory sensor processing in neural networks: lessons from modeling the fruit fly antennal lobe

The insect olfactory system can be a model for artificial olfactory devices. In particular, Drosophila melanogaster due to its genetic tractability has yielded much information about the design and function of such systems in biology. In this study we investigate possible network topologies to separate representations of odors in the primary olfactory neuropil, the antennal lobe. In particular we compare networks based on stochastic and homogeneous connection weight distributions to connectivities that are based on the input correlations between the glomeruli in the antennal lobe. We show that moderate homogeneous inhibition implements a soft winner-take-all mechanism when paired with realistic input from a large meta-database of odor responses in receptor cells (DoOR database). The sparseness of representations increases with stronger inhibition. Excitation, on the other hand, pushes the representation of odors closer together thus making them harder to distinguish. We further analyze the relationship between different inhibitory network topologies and the properties of the receptor responses to different odors. We show that realistic input from the DoOR database has a relatively high entropy of activation values over all odors and receptors compared to the theoretical maximum. Furthermore, under conditions in which the information in the input is artificially decreased, networks with heterogeneous topologies based on the similarity of glomerular response profiles perform best. These results indicate that in order to arrive at the most beneficial representation for odor discrimination it is important to finely tune the strength of inhibition in combination with taking into account the properties of the available sensors.

Nonlinear dimensionality reduction and mapping of compound libraries for drug discovery

Visualization of 'chemical space' and compound distributions has received much attraction by medicinal chemists as it may help to intuitively comprehend pharmaceutically relevant molecular features. It has been realized that for meaningful feature extraction from complex multivariate chemical data, such as compound libraries represented by many molecular descriptors, nonlinear projection techniques are required. Recent advances in machine-learning and artificial intelligence have resulted in a transfer of such methods to chemistry. We provide an overview of prominent visualization methods based on nonlinear dimensionality reduction, and highlight applications in drug discovery. Emphasis is on neural network techniques, kernel methods and stochastic embedding approaches, which have been successfully used for ligand-based virtual screening, SAR landscape analysis, combinatorial library design, and screening compound selection.

Parallel representation of stimulus identity and intensity in a dual pathway model inspired by the olfactory system of the honeybee

The honeybee Apis mellifera has a remarkable ability to detect and locate food sources during foraging, and to associate odor cues with food rewards. In the honeybee's olfactory system, sensory input is first processed in the antennal lobe (AL) network. Uniglomerular projection neurons (PNs) convey the sensory code from the AL to higher brain regions via two parallel but anatomically distinct pathways, the lateral and the medial antenno-cerebral tract (l- and m-ACT). Neurons innervating either tract show characteristic differences in odor selectivity, concentration dependence, and representation of mixtures. It is still unknown how this differential stimulus representation is achieved within the AL network. In this contribution, we use a computational network model to demonstrate that the experimentally observed features of odor coding in PNs can be reproduced by varying lateral inhibition and gain control in an otherwise unchanged AL network. We show that odor coding in the l-ACT supports detection and accurate identification of weak odor traces at the expense of concentration sensitivity, while odor coding in the m-ACT provides the basis for the computation and following of concentration gradients but provides weaker discrimination power. Both coding strategies are mutually exclusive, which creates a tradeoff between detection accuracy and sensitivity. The development of two parallel systems may thus reflect an evolutionary solution to this problem that enables honeybees to achieve both tasks during bee foraging in their natural environment, and which could inspire the development of artificial chemosensory devices for odor-guided navigation in robots.

Map formation in the olfactory bulb by axon guidance of olfactory neurons

The organization of representations in the brain has been observed to locally reflect subspaces of inputs that are relevant to behavioral or perceptual feature combinations, such as in areas receptive to lower and higher-order features in the visual system. The early olfactory system developed highly plastic mechanisms and convergent evidence indicates that projections from primary neurons converge onto the glomerular level of the olfactory bulb (OB) to form a code composed of continuous spatial zones that are differentially active for particular physico-chemical feature combinations, some of which are known to trigger behavioral responses. In a model study of the early human olfactory system, we derive a glomerular organization based on a set of real-world, biologically relevant stimuli, a distribution of receptors that respond each to a set of odorants of similar ranges of molecular properties, and a mechanism of axon guidance based on activity. Apart from demonstrating activity-dependent glomeruli formation and reproducing the relationship of glomerular recruitment with concentration, it is shown that glomerular responses reflect similarities of human odor category perceptions and that further, a spatial code provides a better correlation than a distributed population code. These results are consistent with evidence of functional compartmentalization in the OB and could suggest a function for the bulb in encoding of perceptual dimensions.

A combined perceptual, physico-chemical, and imaging approach to 'odour-distances' suggests a categorizing function of the Drosophila antennal lobe

How do physico-chemical stimulus features, perception, and physiology relate? Given the multi-layered and parallel architecture of brains, the question specifically is where physiological activity patterns correspond to stimulus features and/or perception. Perceived distances between six odour pairs are defined behaviourally from four independent odour recognition tasks. We find that, in register with the physico-chemical distances of these odours, perceived distances for 3-octanol and n-amylacetate are consistently smallest in all four tasks, while the other five odour pairs are about equally distinct. Optical imaging in the antennal lobe, using a calcium sensor transgenically expressed in only first-order sensory or only second-order olfactory projection neurons, reveals that 3-octanol and n-amylacetate are distinctly represented in sensory neurons, but appear merged in projection neurons. These results may suggest that within-antennal lobe processing funnels sensory signals into behaviourally meaningful categories, in register with the physico-chemical relatedness of the odours.

Self-Organizing Maps for In Silico Screening and Data Visualization

Self-organizing maps, which are unsupervised artificial neural networks, have become a very useful tool in a wide area of disciplines, including medicinal chemistry. Here, we will focus on two applications of self-organizing maps: the use of self-organizing maps for in silico screening and for clustering and visualisation of large datasets. Additionally, the importance of parameter selection is discussed and some modifications to the original algorithm are summarised.

Mimicking biological design and computing principles in artificial olfaction

Biology has inspired solutions to many engineering problems, including chemical sensing. Modern approaches to chemical sensing have been based on the biological principle of combining cross-selective chemical sensors with a pattern recognition engine to identify odors. Here, we review some recent advances made in mimicking biological design and computing principles to develop an electronic nose. The resulting technology will have important applications in fundamental biological research, as well as in industrial, security, and medical domains.

The similarity between odors and their binary mixtures in Drosophila

How are odor mixtures perceived? We take a behavioral approach toward this question, using associative odor-recognition experiments in Drosophila. We test how strongly flies avoid a binary mixture after punishment training with one of its constituent elements and how much, in turn, flies avoid an odor element if it had been a component of a previously punished binary mixture. A distinguishing feature of our approach is that we first adjust odors for task-relevant behavioral potency, that is, for equal learnability. Doing so, we find that 1) generalization between mixture and elements is symmetrical and partial, 2) elements are equally similar to all mixtures containing it and that 3) mixtures are equally similar to both their constituent elements. As boundary conditions for the applicability of these rules, we note that first, although variations in learnability are small and remain below statistical cut-off, these variations nevertheless correlate with the elements' perceptual "weight" in the mixture; thus, even small differences in learnability between the elements have the potential to feign mixture asymmetries. Second, the more distant the elements of a mixture are to each other in terms of their physicochemical properties, the more distant the flies regard the elements from the mixture. Thus, titrating for task-relevant behavioral potency and taking into account physicochemical relatedness of odors reveals rules of mixture perception that, maybe surprisingly, appear to be fairly simple.

A behavioral odor similarity "space" in larval Drosophila

To provide a behavior-based estimate of odor similarity in larval Drosophila, we use 4 recognition-type experiments: 1) We train larvae to associate an odor with food and then test whether they would regard another odor as the same as the trained one. 2) We train larvae to associate an odor with food and test whether they prefer the trained odor against a novel nontrained one. 3) We train larvae differentially to associate one odor with food, but not the other one, and test whether they prefer the rewarded against the nonrewarded odor. 4) In an experiment like (3), we test the larvae after a 30-min break. This yields a combined task-independent estimate of perceived difference between odor pairs. Comparing these perceived differences to published measures of physicochemical difference reveals a weak correlation. A notable exception are 3-octanol and benzaldehyde, which are distinct in published accounts of chemical similarity and in terms of their published sensory representation but nevertheless are consistently regarded as the most similar of the 10 odor pairs employed. It thus appears as if at least some aspects of olfactory perception are “computed” in postreceptor circuits on the basis of sensory signals rather than being immediately given by them.

Integrating heterogeneous odor response data into a common response model: A DoOR to the complete olfactome

We have developed a new computational framework for merging odor response data sets from heterogeneous studies, creating a consensus metadatabase, the database of odor responses (DoOR). As a result, we obtained a functional atlas of all available odor responses in Drosophila melanogaster. Both the program and the data set are freely accessible and downloadable on the Internet (http://neuro.uni-konstanz.de/DoOR). The procedure can be adapted to other species, thus creating a family of “olfactomes” in the near future. Drosophila melanogaster was chosen because of all species this one is closest to having the complete olfactome characterized, with the highest number of deorphanized receptors available. The database guarantees long-term stability (by offering time-stamped, downloadable versions), up-to-date accuracy (by including new data sets as soon as they are published), and portability (for other species). We hope that this comprehensive repository of odor response profiles will be useful to the olfactory community and to computational neuroscientists alike.