The past, present, and future of single neuron reconstruction

Smart imaging to empower brain-wide neuroscience at single-cell levels

A deep understanding of the neuronal connectivity and networks with detailed cell typing across brain regions is necessary to unravel the mechanisms behind the emotional and memorial functions as well as to find the treatment of brain impairment. Brain-wide imaging with single-cell resolution provides unique advantages to access morphological features of a neuron and to investigate the connectivity of neuron networks, which has led to exciting discoveries over the past years based on animal models, such as rodents. Nonetheless, high-throughput systems are in urgent demand to support studies of neural morphologies at larger scale and more detailed level, as well as to enable research on non-human primates (NHP) and human brains. The advances in artificial intelligence (AI) and computational resources bring great opportunity to 'smart' imaging systems, i.e., to automate, speed up, optimize and upgrade the imaging systems with AI and computational strategies. In this light, we review the important computational techniques that can support smart systems in brain-wide imaging at single-cell resolution.

Image enhancement to leverage the 3D morphological reconstruction of single-cell neurons

MOTIVATION

To digitally reconstruct the 3D neuron morphologies has long been a major bottleneck in neuroscience. One of the obstacles to automate the procedure is the low signal-background contrast (SBC) and the large dynamic range of signal and background both within and across images.

RESULTS

We developed a pipeline to enhance the neurite signal and to suppress the background, with the goal of high SBC and better within- and between-image homogeneity. The performance of the image enhancement was quantitatively verified according to the different figures of merit benchmarking the image quality. In addition, the method could improve the neuron reconstruction in approximately 1/3 of the cases, with very few cases of degrading the reconstruction. This significantly outperformed three other approaches of image enhancement. Moreover, the compression rate was increased five times by average comparing the enhanced to the raw image. All results demonstrated the potential of the proposed method in leveraging the neuroscience by providing better 3D morphological reconstruction and lower cost of data storage and transfer.

AVAILABILITY AND IMPLEMENTATION

The study is conducted based on the Vaa3D platform and python 3.7.9. The Vaa3D platform is available on the GitHub (https://github.com/Vaa3D). The source code of the proposed image enhancement as a Vaa3D plugin, the source code to benchmark the image quality and the example image blocks are available under the repository of vaa3d_tools/hackathon/SGuo/imPreProcess. The original fMost images of mouse brains can be found at the BICCN's Brain Image Library (BIL) (https://www.brainimagelibrary.org).

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Accurate Neuronal Soma Segmentation Using 3D Multi-Task Learning U-Shaped Fully Convolutional Neural Networks

Neuronal soma segmentation is a crucial step for the quantitative analysis of neuronal morphology. Automated neuronal soma segmentation methods have opened up the opportunity to improve the time-consuming manual labeling required during the neuronal soma morphology reconstruction for large-scale images. However, the presence of touching neuronal somata and variable soma shapes in images brings challenges for automated algorithms. This study proposes a neuronal soma segmentation method combining 3D U-shaped fully convolutional neural networks with multi-task learning. Compared to existing methods, this technique applies multi-task learning to predict the soma boundary to split touching somata, and adopts U-shaped architecture convolutional neural network which is effective for a limited dataset. The contour-aware multi-task learning framework is applied to the proposed method to predict the masks of neuronal somata and boundaries simultaneously. In addition, a spatial attention module is embedded into the multi-task model to improve neuronal soma segmentation results. The Nissl-stained dataset captured by the micro-optical sectioning tomography system is used to validate the proposed method. Following comparison to four existing segmentation models, the proposed method outperforms the others notably in both localization and segmentation. The novel method has potential for high-throughput neuronal soma segmentation in large-scale optical imaging data for neuron morphology quantitative analysis.

A simple method defines 3D morphology and axon projections of filled neurons in a small CNS volume: Steps toward understanding functional network circuitry

BACKGROUND

Fundamental to understanding neuronal network function is defining neuron morphology, location, properties, and synaptic connectivity in the nervous system. A significant challenge is to reconstruct individual neuron morphology and connections at a whole CNS scale and bring together functional and anatomical data to understand the whole network.

NEW METHOD

We used a PC controlled micropositioner to hold a fixed whole mount of Xenopus tadpole CNS and replace the stage on a standard microscope. This allowed direct recording in 3D coordinates of features and axon projections of one or two neurons dye-filled during whole-cell recording to study synaptic connections. Neuron reconstructions were normalised relative to the ventral longitudinal axis of the nervous system. Coordinate data were stored as simple text files.

RESULTS

Reconstructions were at 1 μm resolution, capturing axon lengths in mm. The output files were converted to SWC format and visualised in 3D reconstruction software NeuRomantic. Coordinate data are tractable, allowing correction for histological artefacts. Through normalisation across multiple specimens we could infer features of network connectivity of mapped neurons of different types.

COMPARISON WITH EXISTING METHODS

Unlike other methods using fluorescent markers and utilising large-scale imaging, our method allows direct acquisition of 3D data on neurons whose properties and synaptic connections have been studied using whole-cell recording.

CONCLUSIONS

This method can be used to reconstruct neuron 3D morphology and follow axon projections in the CNS. After normalisation to a common CNS framework, inferences on network connectivity at a whole nervous system scale contribute to network modelling to understand CNS function.

Automated Neuron Reconstruction from 3D Fluorescence Microscopy Images Using Sequential Monte Carlo Estimation

Microscopic images of neuronal cells provide essential structural information about the key constituents of the brain and form the basis of many neuroscientific studies. Computational analyses of the morphological properties of the captured neurons require first converting the structural information into digital tree-like reconstructions. Many dedicated computational methods and corresponding software tools have been and are continuously being developed with the aim to automate this step while achieving human-comparable reconstruction accuracy. This pursuit is hampered by the immense diversity and intricacy of neuronal morphologies as well as the often low quality and ambiguity of the images. Here we present a novel method we developed in an effort to improve the robustness of digital reconstruction against these complicating factors. The method is based on probabilistic filtering by sequential Monte Carlo estimation and uses prediction and update models designed specifically for tracing neuronal branches in microscopic image stacks. Moreover, it uses multiple probabilistic traces to arrive at a more robust, ensemble reconstruction. The proposed method was evaluated on fluorescence microscopy image stacks of single neurons and dense neuronal networks with expert manual annotations serving as the gold standard, as well as on synthetic images with known ground truth. The results indicate that our method performs well under varying experimental conditions and compares favorably to state-of-the-art alternative methods.

ShuTu: Open-Source Software for Efficient and Accurate Reconstruction of Dendritic Morphology

Neurons perform computations by integrating inputs from thousands of synapses-mostly in the dendritic tree-to drive action potential firing in the axon. One fruitful approach to studying this process is to record from neurons using patch-clamp electrodes, fill the recorded neurons with a substance that allows subsequent staining, reconstruct the three-dimensional architectures of the dendrites, and use the resulting functional and structural data to develop computer models of dendritic integration. Accurately producing quantitative reconstructions of dendrites is typically a tedious process taking many hours of manual inspection and measurement. Here we present ShuTu, a new software package that facilitates accurate and efficient reconstruction of dendrites imaged using bright-field microscopy. The program operates in two steps: (1) automated identification of dendritic processes, and (2) manual correction of errors in the automated reconstruction. This approach allows neurons with complex dendritic morphologies to be reconstructed rapidly and efficiently, thus facilitating the use of computer models to study dendritic structure-function relationships and the computations performed by single neurons.

Reconstruction of 1,000 Projection Neurons Reveals New Cell Types and Organization of Long-Range Connectivity in the Mouse Brain

Neuronal cell types are the nodes of neural circuits that determine the flow of information within the brain. Neuronal morphology, especially the shape of the axonal arbor, provides an essential descriptor of cell type and reveals how individual neurons route their output across the brain. Despite the importance of morphology, few projection neurons in the mouse brain have been reconstructed in their entirety. Here we present a robust and efficient platform for imaging and reconstructing complete neuronal morphologies, including axonal arbors that span substantial portions of the brain. We used this platform to reconstruct more than 1,000 projection neurons in the motor cortex, thalamus, subiculum, and hypothalamus. Together, the reconstructed neurons constitute more than 85 meters of axonal length and are available in a searchable online database. Axonal shapes revealed previously unknown subtypes of projection neurons and suggest organizational principles of long-range connectivity.

Brain-Wide Shape Reconstruction of a Traced Neuron Using the Convex Image Segmentation Method

Neuronal shape reconstruction is a helpful technique for establishing neuron identity, inferring neuronal connections, mapping neuronal circuits, and so on. Advances in optical imaging techniques have enabled data collection that includes the shape of a neuron across the whole brain, considerably extending the scope of neuronal anatomy. However, such datasets often include many fuzzy neurites and many crossover regions that neurites are closely attached, which make neuronal shape reconstruction more challenging. In this study, we proposed a convex image segmentation model for neuronal shape reconstruction that segments a neurite into cross sections along its traced skeleton. Both the sparse nature of gradient images and the rule that fuzzy neurites usually have a small radius are utilized to improve neuronal shape reconstruction in regions with fuzzy neurites. Because the model is closely related to the traced skeleton point, we can use this relationship for identifying neurite with crossover regions. We demonstrated the performance of our model on various datasets, including those with fuzzy neurites and neurites with crossover regions, and we verified that our model could robustly reconstruct the neuron shape on a brain-wide scale.

Identifying Weak Signals in Inhomogeneous Neuronal Images for Large-Scale Tracing of Sparsely Distributed Neurites

Tracing neurites constitutes the core of neuronal morphology reconstruction, a key step toward neuronal circuit mapping. Modern optical-imaging techniques allow observation of nearly complete mouse neuron morphologies across brain regions or even the whole brain. However, high-level automation reconstruction of neurons, i.e., the reconstruction with a few of manual edits requires discrimination of weak foreground points from the inhomogeneous background. We constructed an identification model, where empirical observations made from neuronal images were summarized into rules for designing feature vectors that to classify foreground and background, and a support vector machine (SVM) was used to learn these feature vectors. We embedded this constructed SVM classifier into a previously developed tool, SparseTracer, to obtain SparseTracer-Learned Feature Vector (ST-LFV). ST-LFV can trace sparsely distributed neurites with weak signals (contrast-to-noise ratio < 1.5) against an inhomogeneous background in datasets imaged by widely used light-microscopy techniques like confocal microscopy and two-photon microscopy. Moreover, 12 sub-blocks were extracted from different brain regions. The average recall and precision rates were 99% and 97%, respectively. These results indicated that ST-LFV is well suited for weak signal identification with varying image characteristics. We also applied ST-LFV to trace long-range neurites from images where neurites are sparsely distributed but their image intensities are weak in some cases. When tracing this long-range neurites, manual edit was required once to obtain results equivalent to the ground truth, compared with 20 times of manual edits required by SparseTracer. This improvement in the level of automatic reconstruction indicates that ST-LFV has the potential to rapidly reconstruct sparsely distributed neurons at the large scale.

Cell-type-specific and projection-specific brain-wide reconstruction of single neurons

We developed a dual-adeno-associated-virus expression system that enables strong and sparse labeling of individual neurons with cell-type and projection specificity. We demonstrated its utility for whole-brain reconstruction of midbrain dopamine neurons and striatum-projecting cortical neurons. We further extended the labeling method for rapid reconstruction in cleared thick brain sections and simultaneous dual-color labeling. This labeling system may facilitate the process of generating mesoscale single-neuron projectomes of mammalian brains.

A platform for stereological quantitative analysis of the brain-wide distribution of type-specific neurons

Quantifying the distribution of specific neurons throughout the whole brain is crucial for understanding physiological actions, pathological alterations and pharmacological treatments. However, the precise cell number and density of specific neurons in the entire brain remain unknown because of a lack of suitable research tools. Here, we propose a pipeline to automatically acquire and analyse the brain-wide distribution of type-specific neurons in a mouse brain. We employed a Brain-wide Positioning System to collect high-throughput anatomical information with the co-localized cytoarchitecture of the whole brain at subcellular resolution and utilized the NeuroGPS algorithm to locate and count cells in the whole brain. We evaluated the data continuity of the 3D dataset and the accuracy of stereological cell counting in 3D. To apply this pipeline, we acquired and quantified the brain-wide distributions and somatic morphology of somatostatin-expressing neurons in transgenic mouse brains. The results indicated that this whole-brain cell counting pipeline has the potential to become a routine tool for cell type neuroscience studies.

Touching Soma Segmentation Based on the Rayburst Sampling Algorithm

Neuronal soma segmentation is essential for morphology quantification analysis. Rapid advances in light microscope imaging techniques have generated such massive amounts of data that time-consuming manual methods cannot meet requirements for high throughput. However, touching soma segmentation is still a challenge for automatic segmentation methods. In this paper, we propose a soma segmentation method that combines the Rayburst sampling algorithm and ellipsoid fitting. The improved Rayburst sampling algorithm is used to detect the soma surface; the ellipsoid fitting method then refines jagged sampled soma surface to generate smooth ellipsoidal shapes for efficient analysis. In experiments, we validated the proposed method by applying it to datasets from the fluorescence micro-optical sectioning tomography (fMOST) system. The results indicate that the proposed method is comparable to the manual segmented gold standard with accurate soma segmentation at a relatively high speed. The proposed method can be extended to large-scale image stacks in the future.

Automated neuron tracing using probability hypothesis density filtering

Motivation

The functionality of neurons and their role in neuronal networks is tightly connected to the cell morphology. A fundamental problem in many neurobiological studies aiming to unravel this connection is the digital reconstruction of neuronal cell morphology from microscopic image data. Many methods have been developed for this, but they are far from perfect, and better methods are needed.

Results

Here we present a new method for tracing neuron centerlines needed for full reconstruction. The method uses a fundamentally different approach than previous methods by considering neuron tracing as a Bayesian multi-object tracking problem. The problem is solved using probability hypothesis density filtering. Results of experiments on 2D and 3D fluorescence microscopy image datasets of real neurons indicate the proposed method performs comparably or even better than the state of the art.

Availability and Implementation

Software implementing the proposed neuron tracing method was written in the Java programming language as a plugin for the ImageJ platform. Source code is freely available for non-commercial use at https://bitbucket.org/miroslavradojevic/phd .

Contact

meijering@imagescience.org.

Supplementary information

Supplementary data are available at Bioinformatics online.

Fuzzy-Logic Based Detection and Characterization of Junctions and Terminations in Fluorescence Microscopy Images of Neurons

Digital reconstruction of neuronal cell morphology is an important step toward understanding the functionality of neuronal networks. Neurons are tree-like structures whose description depends critically on the junctions and terminations, collectively called critical points, making the correct localization and identification of these points a crucial task in the reconstruction process. Here we present a fully automatic method for the integrated detection and characterization of both types of critical points in fluorescence microscopy images of neurons. In view of the majority of our current studies, which are based on cultured neurons, we describe and evaluate the method for application to two-dimensional (2D) images. The method relies on directional filtering and angular profile analysis to extract essential features about the main streamlines at any location in an image, and employs fuzzy logic with carefully designed rules to reason about the feature values in order to make well-informed decisions about the presence of a critical point and its type. Experiments on simulated as well as real images of neurons demonstrate the detection performance of our method. A comparison with the output of two existing neuron reconstruction methods reveals that our method achieves substantially higher detection rates and could provide beneficial information to the reconstruction process.

Improved detection of soma location and morphology in fluorescence microscopy images of neurons

BACKGROUND

Automated detection and segmentation of somas in fluorescent images of neurons is a major goal in quantitative studies of neuronal networks, including applications of high-content-screenings where it is required to quantify multiple morphological properties of neurons. Despite recent advances in image processing targeted to neurobiological applications, existing algorithms of soma detection are often unreliable, especially when processing fluorescence image stacks of neuronal cultures.

NEW METHOD

In this paper, we introduce an innovative algorithm for the detection and extraction of somas in fluorescent images of networks of cultured neurons where somas and other structures exist in the same fluorescent channel. Our method relies on a new geometrical descriptor called Directional Ratio and a collection of multiscale orientable filters to quantify the level of local isotropy in an image. To optimize the application of this approach, we introduce a new construction of multiscale anisotropic filters that is implemented by separable convolution.

RESULTS

Extensive numerical experiments using 2D and 3D confocal images show that our automated algorithm reliably detects somas, accurately segments them, and separates contiguous ones.

COMPARISON WITH EXISTING METHODS

We include a detailed comparison with state-of-the-art existing methods to demonstrate that our algorithm is extremely competitive in terms of accuracy, reliability and computational efficiency.

CONCLUSIONS

Our algorithm will facilitate the development of automated platforms for high content neuron image processing. A Matlab code is released open-source and freely available to the scientific community.

Visible rodent brain-wide networks at single-neuron resolution

There are some unsolvable fundamental questions, such as cell type classification, neural circuit tracing and neurovascular coupling, though great progresses are being made in neuroscience. Because of the structural features of neurons and neural circuits, the solution of these questions needs us to break through the current technology of neuroanatomy for acquiring the exactly fine morphology of neuron and vessels and tracing long-distant circuit at axonal resolution in the whole brain of mammals. Combined with fast-developing labeling techniques, efficient whole-brain optical imaging technology emerging at the right moment presents a huge potential in the structure and function research of specific-function neuron and neural circuit. In this review, we summarize brain-wide optical tomography techniques, review the progress on visible brain neuronal/vascular networks benefit from these novel techniques, and prospect the future technical development.

Automated detection of soma location and morphology in neuronal network cultures

Automated identification of the primary components of a neuron and extraction of its sub-cellular features are essential steps in many quantitative studies of neuronal networks. The focus of this paper is the development of an algorithm for the automated detection of the location and morphology of somas in confocal images of neuronal network cultures. This problem is motivated by applications in high-content screenings (HCS), where the extraction of multiple morphological features of neurons on large data sets is required. Existing algorithms are not very efficient when applied to the analysis of confocal image stacks of neuronal cultures. In addition to the usual difficulties associated with the processing of fluorescent images, these types of stacks contain a small number of images so that only a small number of pixels are available along the z-direction and it is challenging to apply conventional 3D filters. The algorithm we present in this paper applies a number of innovative ideas from the theory of directional multiscale representations and involves the following steps: (i) image segmentation based on support vector machines with specially designed multiscale filters; (ii) soma extraction and separation of contiguous somas, using a combination of level set method and directional multiscale filters. We also present an approach to extract the soma's surface morphology using the 3D shearlet transform. Extensive numerical experiments show that our algorithms are computationally efficient and highly accurate in segmenting the somas and separating contiguous ones. The algorithms presented in this paper will facilitate the development of a high-throughput quantitative platform for the study of neuronal networks for HCS applications.

Beyond Columnar Organization: Cell Type- and Target Layer-Specific Principles of Horizontal Axon Projection Patterns in Rat Vibrissal Cortex

Vertical thalamocortical afferents give rise to the elementary functional units of sensory cortex, cortical columns. Principles that underlie communication between columns remain however unknown. Here we unravel these by reconstructing in vivo-labeled neurons from all excitatory cell types in the vibrissal part of rat primary somatosensory cortex (vS1). Integrating the morphologies into an exact 3D model of vS1 revealed that the majority of intracortical (IC) axons project far beyond the borders of the principal column. We defined the corresponding innervation volume as the IC-unit. Deconstructing this structural cortical unit into its cell type-specific components, we found asymmetric projections that innervate columns of either the same whisker row or arc, and which subdivide vS1 into 2 orthogonal [supra-]granular and infragranular strata. We show that such organization could be most effective for encoding multi whisker inputs. Communication between columns is thus organized by multiple highly specific horizontal projection patterns, rendering IC-units as the primary structural entities for processing complex sensory stimuli.

Longitudinal in vivo two-photon fluorescence imaging

Fluorescence microscopy is an essential technique for the basic sciences, especially biomedical research. Since the invention of laser scanning confocal microscopy in the 1980s, which enabled imaging both fixed and living biological tissue with 3D precision, high-resolution fluorescence imaging has revolutionized biological research. Confocal microscopy, by its very nature, has one fundamental limitation. Due to the confocal pinhole, deep tissue fluorescence imaging is not practical. In contrast (no pun intended), two-photon fluorescence microscopy allows, in principle, the collection of all emitted photons from fluorophores in the imaged voxel, dramatically extending our ability to see deep into living tissue. Since the development of transgenic mice with genetically encoded fluorescent protein in neocortical cells in 2000, two-photon imaging has enabled the dynamics of individual synapses to be followed for up to 2 years. Since the initial landmark contributions to this field in 2002, the technique has been used to understand how neuronal structure are changed by experience, learning, and memory and various diseases. Here we provide a basic summary of the crucial elements that are required for such studies, and discuss many applications of longitudinal two-photon fluorescence microscopy that have appeared since 2002.

A comparison of manual neuronal reconstruction from biocytin histology or 2-photon imaging: morphometry and computer modeling

Accurate 3D reconstruction of neurons is vital for applications linking anatomy and physiology. Reconstructions are typically created using Neurolucida after biocytin histology (BH). An alternative inexpensive and fast method is to use freeware such as Neuromantic to reconstruct from fluorescence imaging (FI) stacks acquired using 2-photon laser-scanning microscopy during physiological recording. We compare these two methods with respect to morphometry, cell classification, and multicompartmental modeling in the NEURON simulation environment. Quantitative morphological analysis of the same cells reconstructed using both methods reveals that whilst biocytin reconstructions facilitate tracing of more distal collaterals, both methods are comparable in representing the overall morphology: automated clustering of reconstructions from both methods successfully separates neocortical basket cells from pyramidal cells but not BH from FI reconstructions. BH reconstructions suffer more from tissue shrinkage and compression artifacts than FI reconstructions do. FI reconstructions, on the other hand, consistently have larger process diameters. Consequently, significant differences in NEURON modeling of excitatory post-synaptic potential (EPSP) forward propagation are seen between the two methods, with FI reconstructions exhibiting smaller depolarizations. Simulated action potential backpropagation (bAP), however, is indistinguishable between reconstructions obtained with the two methods. In our hands, BH reconstructions are necessary for NEURON modeling and detailed morphological tracing, and thus remain state of the art, although they are more labor intensive, more expensive, and suffer from a higher failure rate due to the occasional poor outcome of histological processing. However, for a subset of anatomical applications such as cell type identification, FI reconstructions are superior, because of indistinguishable classification performance with greater ease of use, essentially 100% success rate, and lower cost.

Active learning of neuron morphology for accurate automated tracing of neurites

Automating the process of neurite tracing from light microscopy stacks of images is essential for large-scale or high-throughput quantitative studies of neural circuits. While the general layout of labeled neurites can be captured by many automated tracing algorithms, it is often not possible to differentiate reliably between the processes belonging to different cells. The reason is that some neurites in the stack may appear broken due to imperfect labeling, while others may appear fused due to the limited resolution of optical microscopy. Trained neuroanatomists routinely resolve such topological ambiguities during manual tracing tasks by combining information about distances between branches, branch orientations, intensities, calibers, tortuosities, colors, as well as the presence of spines or boutons. Likewise, to evaluate different topological scenarios automatically, we developed a machine learning approach that combines many of the above mentioned features. A specifically designed confidence measure was used to actively train the algorithm during user-assisted tracing procedure. Active learning significantly reduces the training time and makes it possible to obtain less than 1% generalization error rates by providing few training examples. To evaluate the overall performance of the algorithm a number of image stacks were reconstructed automatically, as well as manually by several trained users, making it possible to compare the automated traces to the baseline inter-user variability. Several geometrical and topological features of the traces were selected for the comparisons. These features include the total trace length, the total numbers of branch and terminal points, the affinity of corresponding traces, and the distances between corresponding branch and terminal points. Our results show that when the density of labeled neurites is sufficiently low, automated traces are not significantly different from manual reconstructions obtained by trained users.

An anterograde rabies virus vector for high-resolution large-scale reconstruction of 3D neuron morphology

Glycoprotein-deleted rabies virus (RABV ∆G) is a powerful tool for the analysis of neural circuits. Here, we demonstrate the utility of an anterograde RABV ∆G variant for novel neuroanatomical approaches involving either bulk or sparse neuronal populations. This technology exploits the unique features of RABV ∆G vectors, namely autonomous, rapid high-level expression of transgenes, and limited cytotoxicity. Our vector permits the unambiguous long-range and fine-scale tracing of the entire axonal arbor of individual neurons throughout the brain. Notably, this level of labeling can be achieved following infection with a single viral particle. The vector is effective over a range of ages (>14 months) aiding the studies of neurodegenerative disorders or aging, and infects numerous cell types in all brain regions tested. Lastly, it can also be readily combined with retrograde RABV ∆G variants. Together with other modern technologies, this tool provides new possibilities for the investigation of the anatomy and physiology of neural circuits.

MorphoNeuroNet: an automated method for dense neurite network analysis

High content cell-based screens are rapidly gaining popularity in the context of neuronal regeneration studies. To analyze neuronal morphology, automatic image analysis pipelines have been conceived, which accurately quantify the shape changes of neurons in cell cultures with non-dense neurite networks. However, most existing methods show poor performance for well-connected and differentiated neuronal networks, which may serve as valuable models for inter alia synaptogenesis. Here, we present a fully automated method for quantifying the morphology of neurons and the density of neurite networks, in dense neuronal cultures, which are grown for more than 10 days. MorphoNeuroNet, written as a script for ImageJ, Java based freeware, automatically determines various morphological parameters of the soma and the neurites (size, shape, starting points, and fractional occupation). The image analysis pipeline consists of a multi-tier approach in which the somas are segmented by adaptive region growing using nuclei as seeds, and the neurites are delineated by a combination of various intensity and edge detection algorithms. Quantitative comparison showed a superior performance of MorphoNeuroNet to existing analysis tools, especially for revealing subtle changes in thin neurites, which have weak fluorescence intensity compared to the rest of the network. The proposed method will help determining the effects of compounds on cultures with dense neurite networks, thereby boosting physiological relevance of cell-based assays in the context of neuronal diseases.

Automated and accurate detection of soma location and surface morphology in large-scale 3D neuron images

Automated and accurate localization and morphometry of somas in 3D neuron images is essential for quantitative studies of neural networks in the brain. However, previous methods are limited in obtaining the location and surface morphology of somas with variable size and uneven staining in large-scale 3D neuron images. In this work, we proposed a method for automated soma locating in large-scale 3D neuron images that contain relatively sparse soma distributions. This method involves three steps: (i) deblocking the image with overlap between adjacent sub-stacks; (ii) locating the somas in each small sub-stack using multi-scale morphological close and adaptive thresholds; and (iii) fusion of the repeatedly located somas in all sub-stacks. We also describe a new method for the accurate detection of the surface morphology of somas containing hollowness; this was achieved by improving the classical Rayburst Sampling with a new gradient-based criteria. Three 3D neuron image stacks of different sizes were used to quantitatively validate our methods. For the soma localization algorithm, the average recall and precision were greater than 93% and 96%, respectively. For the soma surface detection algorithm, the overlap of the volumes created by automatic detection of soma surfaces and manually segmenting soma volumes was more than 84% for 89% of all correctly detected somas. Our method for locating somas can reveal the soma distributions in large-scale neural networks more efficiently. The method for soma surface detection will serve as a valuable tool for systematic studies of neuron types based on neuron structure.

Neuronal morphology goes digital: a research hub for cellular and system neuroscience

The importance of neuronal morphology in brain function has been recognized for over a century. The broad applicability of "digital reconstructions" of neuron morphology across neuroscience subdisciplines has stimulated the rapid development of numerous synergistic tools for data acquisition, anatomical analysis, three-dimensional rendering, electrophysiological simulation, growth models, and data sharing. Here we discuss the processes of histological labeling, microscopic imaging, and semiautomated tracing. Moreover, we provide an annotated compilation of currently available resources in this rich research "ecosystem" as a central reference for experimental and computational neuroscience.

Automatic reconstruction of neural morphologies with multi-scale tracking

Neurons have complex axonal and dendritic morphologies that are the structural building blocks of neural circuits. The traditional method to capture these morphological structures using manual reconstructions is time-consuming and partly subjective, so it appears important to develop automatic or semi-automatic methods to reconstruct neurons. Here we introduce a fast algorithm for tracking neural morphologies in 3D with simultaneous detection of branching processes. The method is based on existing tracking procedures, adding the machine vision technique of multi-scaling. Starting from a seed point, our algorithm tracks axonal or dendritic arbors within a sphere of a variable radius, then moves the sphere center to the point on its surface with the shortest Dijkstra path, detects branching points on the surface of the sphere, scales it until branches are well separated and then continues tracking each branch. We evaluate the performance of our algorithm on preprocessed data stacks obtained by manual reconstructions of neural cells, corrupted with different levels of artificial noise, and unprocessed data sets, achieving 90% precision and 81% recall in branch detection. We also discuss limitations of our method, such as reconstructing highly overlapping neural processes, and suggest possible improvements. Multi-scaling techniques, well suited to detect branching structures, appear a promising strategy for automatic neuronal reconstructions.

Digital reconstructions of neuronal morphology: three decades of research trends

The importance of neuronal morphology has been recognized from the early days of neuroscience. Elucidating the functional roles of axonal and dendritic arbors in synaptic integration, signal transmission, network connectivity, and circuit dynamics requires quantitative analyses of digital three-dimensional reconstructions. We extensively searched the scientific literature for all original reports describing reconstructions of neuronal morphology since the advent of this technique three decades ago. From almost 50,000 titles, 30,000 abstracts, and more than 10,000 full-text articles, we identified 902 publications describing ∼44,000 digital reconstructions. Reviewing the growth of this field exposed general research trends on specific animal species, brain regions, neuron types, and experimental approaches. The entire bibliography, annotated with relevant metadata and (wherever available) direct links to the underlying digital data, is accessible at NeuroMorpho.Org.

Neuromantic - from semi-manual to semi-automatic reconstruction of neuron morphology

The ability to create accurate geometric models of neuronal morphology is important for understanding the role of shape in information processing. Despite a significant amount of research on automating neuron reconstructions from image stacks obtained via microscopy, in practice most data are still collected manually. This paper describes Neuromantic, an open source system for three dimensional digital tracing of neurites. Neuromantic reconstructions are comparable in quality to those of existing commercial and freeware systems while balancing speed and accuracy of manual reconstruction. The combination of semi-automatic tracing, intuitive editing, and ability of visualizing large image stacks on standard computing platforms provides a versatile tool that can help address the reconstructions availability bottleneck. Practical considerations for reducing the computational time and space requirements of the extended algorithm are also discussed.

Automated 4D analysis of dendritic spine morphology: applications to stimulus-induced spine remodeling and pharmacological rescue in a disease model

Uncovering the mechanisms that regulate dendritic spine morphology has been limited, in part, by the lack of efficient and unbiased methods for analyzing spines. Here, we describe an automated 3D spine morphometry method and its application to spine remodeling in live neurons and spine abnormalities in a disease model. We anticipate that this approach will advance studies of synapse structure and function in brain development, plasticity, and disease.

Semi-automated three-dimensional reconstructions of individual neurons reveal cell type-specific circuits in cortex

Despite a long history of anatomical mapping of neuronal networks, we are only beginning to understand the detailed three-dimensional (3D) organization of the cortical micro-circuitry. This is in part due to the lack of complete reconstructions of individual cortical neurons. Morphological studies are either performed on incomplete cells in vitro, or when performed in vivo, lack the necessary cellular resolution. We recently reconstructed the in vivo axonal and dendritic morphology of two types of L(ayer) 5 neurons from vibrissal cortex. The 3D profiles of short-range as well as longrange projections indicate that L5 slender-tufted and L5 thick-tufted neurons represent very different building blocks of the cortical circuitry. In this addendum to Oberlaender et al. (PNAS 2011), we motivate our technical approach and the advancements this may give in reconstructing the cortical micro-circuitry.