Automated detection of soma location and morphology in neuronal network cultures

Connecto-informatics at the mesoscale: current advances in image processing and analysis for mapping the brain connectivity

Mapping neural connections within the brain has been a fundamental goal in neuroscience to understand better its functions and changes that follow aging and diseases. Developments in imaging technology, such as microscopy and labeling tools, have allowed researchers to visualize this connectivity through high-resolution brain-wide imaging. With this, image processing and analysis have become more crucial. However, despite the wealth of neural images generated, access to an integrated image processing and analysis pipeline to process these data is challenging due to scattered information on available tools and methods. To map the neural connections, registration to atlases and feature extraction through segmentation and signal detection are necessary. In this review, our goal is to provide an updated overview of recent advances in these image-processing methods, with a particular focus on fluorescent images of the mouse brain. Our goal is to outline a pathway toward an integrated image-processing pipeline tailored for connecto-informatics. An integrated workflow of these image processing will facilitate researchers' approach to mapping brain connectivity to better understand complex brain networks and their underlying brain functions. By highlighting the image-processing tools available for fluroscent imaging of the mouse brain, this review will contribute to a deeper grasp of connecto-informatics, paving the way for better comprehension of brain connectivity and its implications.

Machine learning approach for recognition and morphological analysis of isolated astrocytes in phase contrast microscopy

Astrocytes are glycolytically active cells in the central nervous system playing a crucial role in various brain processes from homeostasis to neurotransmission. Astrocytes possess a complex branched morphology, frequently examined by fluorescent microscopy. However, staining and fixation may impact the properties of astrocytes, thereby affecting the accuracy of the experimental data of astrocytes dynamics and morphology. On the other hand, phase contrast microscopy can be used to study astrocytes morphology without affecting them, but the post-processing of the resulting low-contrast images is challenging. The main result of this work is a novel approach for recognition and morphological analysis of unstained astrocytes based on machine-learning recognition of microscopic images. We conducted a series of experiments involving the cultivation of isolated astrocytes from the rat brain cortex followed by microscopy. Using the proposed approach, we tracked the temporal evolution of the average total length of branches, branching, and area per astrocyte in our experiments. We believe that the proposed approach and the obtained experimental data will be of interest and benefit to the scientific communities in cell biology, biophysics, and machine learning.

A Deep Learning Approach for Neuronal Cell Body Segmentation in Neurons Expressing GCaMP Using a Swin Transformer

Neuronal cell body analysis is crucial for quantifying changes in neuronal sizes under different physiological and pathologic conditions. Neuronal cell body detection and segmentation mainly rely on manual or pseudo-manual annotations. Manual annotation of neuronal boundaries is time-consuming, requires human expertise, and has intra/interobserver variances. Also, determining where the neuron's cell body ends and where the axons and dendrites begin is taxing. We developed a deep-learning-based approach that uses a state-of-the-art shifted windows (Swin) transformer for automated, reproducible, fast, and unbiased 2D detection and segmentation of neuronal somas imaged in mouse acute brain slices by multiphoton microscopy. We tested our Swin algorithm during different experimental conditions of low and high signal fluorescence. Our algorithm achieved a mean Dice score of 0.91, a precision of 0.83, and a recall of 0.86. Compared with two different convolutional neural networks, the Swin transformer outperformed them in detecting the cell boundaries of GCamP6s expressing neurons. Thus, our Swin transform algorithm can assist in the fast and accurate segmentation of fluorescently labeled neuronal cell bodies in thick acute brain slices. Using our flexible algorithm, researchers can better study the fluctuations in neuronal soma size during physiological and pathologic conditions.

3D Soma Detection in Large-Scale Whole Brain Images via a Two-Stage Neural Network

3D soma detection in whole brain images is a critical step for neuron reconstruction. However, existing soma detection methods are not suitable for whole mouse brain images with large amounts of data and complex structure. In this paper, we propose a two-stage deep neural network to achieve fast and accurate soma detection in large-scale and high-resolution whole mouse brain images (more than 1TB). For the first stage, a lightweight Multi-level Cross Classification Network (MCC-Net) is proposed to filter out images without somas and generate coarse candidate images by combining the advantages of the multi convolution layer's feature extraction ability. It can speed up the detection of somas and reduce the computational complexity. For the second stage, to further obtain the accurate locations of somas in the whole mouse brain images, the Scale Fusion Segmentation Network (SFS-Net) is developed to segment soma regions from candidate images. Specifically, the SFS-Net captures multi-scale context information and establishes a complementary relationship between encoder and decoder by combining the encoder-decoder structure and a 3D Scale-Aware Pyramid Fusion (SAPF) module for better segmentation performance. The experimental results on three whole mouse brain images verify that the proposed method can achieve excellent performance and provide the reconstruction of neurons with beneficial information. Additionally, we have established a public dataset named WBMSD, including 798 high-resolution and representative images ( 256 ×256 ×256 voxels) from three whole mouse brain images, dedicated to the research of soma detection, which will be released along with this paper.

Foreground Estimation in Neuronal Images With a Sparse-Smooth Model for Robust Quantification

3D volume imaging has been regarded as a basic tool to explore the organization and function of the neuronal system. Foreground estimation from neuronal image is essential in the quantification and analysis of neuronal image such as soma counting, neurite tracing and neuron reconstruction. However, the complexity of neuronal structure itself and differences in the imaging procedure, including different optical systems and biological labeling methods, result in various and complex neuronal images, which greatly challenge foreground estimation from neuronal image. In this study, we propose a robust sparse-smooth model (RSSM) to separate the foreground and the background of neuronal image. The model combines the different smoothness levels of the foreground and the background, and the sparsity of the foreground. These prior constraints together contribute to the robustness of foreground estimation from a variety of neuronal images. We demonstrate the proposed RSSM method could promote some best available tools to trace neurites or locate somas from neuronal images with their default parameters, and the quantified results are similar or superior to the results that generated from the original images. The proposed method is proved to be robust in the foreground estimation from different neuronal images, and helps to improve the usability of current quantitative tools on various neuronal images with several applications.

DeepRayburst for Automatic Shape Analysis of Tree-Like Structures in Biomedical Images

Precise quantification of tree-like structures from biomedical images, such as neuronal shape reconstruction and retinal blood vessel caliber estimation, is increasingly important in understanding normal function and pathologic processes in biology. Some handcrafted methods have been proposed for this purpose in recent years. However, they are designed only for a specific application. In this paper, we propose a shape analysis algorithm, DeepRayburst, that can be applied to many different applications based on a Multi-Feature Rayburst Sampling (MFRS) and a Dual Channel Temporal Convolutional Network (DC-TCN). Specifically, we first generate a Rayburst Sampling (RS) core containing a set of multidirectional rays. Then the MFRS is designed by extending each ray of the RS to multiple parallel rays which extract a set of feature sequences. A Gaussian kernel is then used to fuse these feature sequences and outputs one feature sequence. Furthermore, we design a DC-TCN to make the rays terminate on the surface of tree-like structures according to the fused feature sequence. Finally, by analyzing the distribution patterns of the terminated rays, the algorithm can serve multiple shape analysis applications of tree-like structures. Experiments on three different applications, including soma shape reconstruction, neuronal shape reconstruction, and vessel caliber estimation, confirm that the proposed method outperforms other state-of-the-art shape analysis methods, which demonstrate its flexibility and robustness.

Precise Mapping of Single Neurons by Calibrated 3D Reconstruction of Brain Slices Reveals Topographic Projection in Mouse Visual Cortex

Recent breakthroughs in neuroanatomical tracing methods have helped unravel complicated neural connectivity in whole-brain tissue at single-cell resolution. However, in most cases, analysis of brain images remains dependent on highly subjective and sample-specific manual processing, preventing precise comparison across sample animals. In the present study, we introduce AMaSiNe, software for automated mapping of single neurons in the standard mouse brain atlas with annotated regions. AMaSiNe automatically calibrates misaligned and deformed slice samples to locate labeled neuronal positions from multiple brain samples into the standardized 3D Allen Mouse Brain Reference Atlas. We exploit the high fidelity and reliability of AMaSiNe to investigate the topographic structures of feedforward projections from the lateral geniculate nucleus to the primary visual area by reconstructing rabies-virus-injected brain slices in 3D space. Our results demonstrate that distinct organization of neural projections can be precisely mapped using AMaSiNe.

ANMAF: an automated neuronal morphology analysis framework using convolutional neural networks

Measurement of neuronal size is challenging due to their complex histology. Current practice includes manual or pseudo-manual measurement of somatic areas, which is labor-intensive and prone to human biases and intra-/inter-observer variances. We developed a novel high-throughput neuronal morphology analysis framework (ANMAF), using convolutional neural networks (CNN) to automatically contour the somatic area of fluorescent neurons in acute brain slices. Our results demonstrate considerable agreements between human annotators and ANMAF on detection, segmentation, and the area of somatic regions in neurons expressing a genetically encoded fluorophore. However, in contrast to humans, who exhibited significant variability in repeated measurements, ANMAF produced consistent neuronal contours. ANMAF was generalizable across different imaging protocols and trainable even with a small number of humanly labeled neurons. Our framework can facilitate more rigorous and quantitative studies of neuronal morphology by enabling the segmentation of many fluorescent neurons in thick brain slices in a standardized manner.

Quantitative Determination of Cellular-and Neurite Motility Speed in Dense Cell Cultures

Mobility quantification of single cells and cellular processes in dense cultures is a challenge, because single cell tracking is impossible. We developed a software for cell structure segmentation and implemented 2 algorithms to measure motility speed. Complex algorithms were tested to separate cells and cellular components, an important prerequisite for the acquisition of meaningful motility data. Plasma membrane segmentation was performed to measure membrane contraction dynamics and organelle trafficking. The discriminative performance and sensitivity of the algorithms were tested on different cell types and calibrated on computer-simulated cells to obtain absolute values for cellular velocity. Both motility algorithms had advantages in different experimental setups, depending on the complexity of the cellular movement. The correlation algorithm (COPRAMove) performed best under most tested conditions and appeared less sensitive to variable cell densities, brightness and focus changes than the differentiation algorithm (DiffMove). In summary, our software can be used successfully to analyze and quantify cellular and subcellular movements in dense cell cultures.

Soma Detection in 3D Images of Neurons using Machine Learning Technique

Computing and analyzing the neuronal structure is essential to studying connectome. Two important tasks for such analysis are finding the soma and constructing the neuronal structure. Finding the soma is considered more important because it is required for some neuron tracing algorithms. We describe a robust automatic soma detection method developed based on the machine learning technique. Images of neurons were three-dimensional confocal microscopic images in the FlyCircuit database. The testing data were randomly selected raw images that contained noises and partial neuronal structures. The number of somas in the images was not known in advance. Our method tries to identify all the somas in the images. Experimental results showed that the method is efficient and robust.

Automated 3D Soma Segmentation with Morphological Surface Evolution for Neuron Reconstruction

The automatic neuron reconstruction is important since it accelerates the collection of 3D neuron models for the neuronal morphological studies. The majority of the previous neuron reconstruction methods only focused on tracing neuron fibres without considering the somatic surface. Thus, topological errors often present around the soma area in the results obtained by these tracing methods. Segmentation of the soma structures can be embedded in the existing neuron tracing methods to reduce such topological errors. In this paper, we present a novel method to segment the soma structures with complex geometry. It can be applied along with the existing methods in a fully automated pipeline. An approximate bounding block is firstly estimated based on a geodesic distance transform. Then the soma segmentation is obtained by evolving the surface with a set of morphological operators inside the initial bounding region. By evaluating the methods against the challenging images released by the BigNeuron project, we showed that the proposed method can outperform the existing soma segmentation methods regarding the accuracy. We also showed that the soma segmentation can be used for enhancing the results of existing neuron tracing methods.

Automated sorting of neuronal trees in fluorescent images of neuronal networks using NeuroTreeTracer

Fluorescence confocal microscopy has become increasingly more important in neuroscience due to its applications in image-based screening and profiling of neurons. Multispectral confocal imaging is useful to simultaneously probe for distribution of multiple analytes over networks of neurons. However, current automated image analysis algorithms are not designed to extract single-neuron arbors in images where neurons are not separated, hampering the ability map fluorescence signals at the single cell level. To overcome this limitation, we introduce NeuroTreeTracer - a novel image processing framework aimed at automatically extracting and sorting single-neuron traces in fluorescent images of multicellular neuronal networks. This method applies directional multiscale filters for automated segmentation of neurons and soma detection, and includes a novel tracing routine that sorts neuronal trees in the image by resolving network connectivity even when neurites appear to intersect. By extracting each neuronal tree, NeuroTreetracer enables to automatically quantify the spatial distribution of analytes of interest in the subcellular compartments of individual neurons. This software is released open-source and freely available with the goal to facilitate applications in neuron screening and profiling.

On the assessments of arabinoxylan localization and enzymatic modifications for enhanced protein networking and its structural impact on rye dough and bread

For rye dough structure, it is hypothesised that the presence of arabinoxylan hinders the proteins from forming a coherent network. This hypothesis was investigated using fluorescent-stained antibodies that bind to the arabinoxylan chains. Image analysis proves that the arabinoxylan surrounds the proteins, negatively affecting protein networking. Further, it is hypothesised that the dosing of xylanase and transglutaminase has a positive impact on rye dough and bread characteristics; the findings in this study evidenced that this increases the protein network by up to 38% accompanied by a higher volume rise of 10.67%, compared to standard rye dough. These outcomes combine a product-oriented and physiochemical design of a recipe, targeting structural and functional relationships, and demonstrate a successful methodology for enhancing rye bread quality.

Improved detection of soma location and morphology in fluorescence microscopy images of neurons

BACKGROUND

Automated detection and segmentation of somas in fluorescent images of neurons is a major goal in quantitative studies of neuronal networks, including applications of high-content-screenings where it is required to quantify multiple morphological properties of neurons. Despite recent advances in image processing targeted to neurobiological applications, existing algorithms of soma detection are often unreliable, especially when processing fluorescence image stacks of neuronal cultures.

NEW METHOD

In this paper, we introduce an innovative algorithm for the detection and extraction of somas in fluorescent images of networks of cultured neurons where somas and other structures exist in the same fluorescent channel. Our method relies on a new geometrical descriptor called Directional Ratio and a collection of multiscale orientable filters to quantify the level of local isotropy in an image. To optimize the application of this approach, we introduce a new construction of multiscale anisotropic filters that is implemented by separable convolution.

RESULTS

Extensive numerical experiments using 2D and 3D confocal images show that our automated algorithm reliably detects somas, accurately segments them, and separates contiguous ones.

COMPARISON WITH EXISTING METHODS

We include a detailed comparison with state-of-the-art existing methods to demonstrate that our algorithm is extremely competitive in terms of accuracy, reliability and computational efficiency.

CONCLUSIONS

Our algorithm will facilitate the development of automated platforms for high content neuron image processing. A Matlab code is released open-source and freely available to the scientific community.

Multiscale Analysis of Neurite Orientation and Spatial Organization in Neuronal Images

The spatial organization of neurites, the thin processes (i.e., dendrites and axons) that stem from a neuron's soma, conveys structural information required for proper brain function. The alignment, direction and overall geometry of neurites in the brain are subject to continuous remodeling in response to healthy and noxious stimuli. In the developing brain, during neurogenesis or in neuroregeneration, these structural changes are indicators of the ability of neurons to establish axon-to-dendrite connections that can ultimately develop into functional synapses. Enabling a proper quantification of this structural remodeling would facilitate the identification of new phenotypic criteria to classify developmental stages and further our understanding of brain function. However, adequate algorithms to accurately and reliably quantify neurite orientation and alignment are still lacking. To fill this gap, we introduce a novel algorithm that relies on multiscale directional filters designed to measure local neurites orientation over multiple scales. This innovative approach allows us to discriminate the physical orientation of neurites from finer scale phenomena associated with local irregularities and noise. Building on this multiscale framework, we also introduce a notion of alignment score that we apply to quantify the degree of spatial organization of neurites in tissue and cultured neurons. Numerical codes were implemented in Python and released open source and freely available to the scientific community.

Improved Methods for Fluorescence Microscopy Detection of Macromolecules at the Axon Initial Segment

The axonal initial segment (AIS) is the subcellular compartment required for initiation of the action potential in neurons. Scaffolding and regulatory proteins at the AIS cluster with ion channels ensuring the integrity of electrical signaling. Interference with the configuration of this protein network can lead to profound effects on neuronal polarity, excitability, cell-to-cell connectivity and brain circuit plasticity. As such, the ability to visualize AIS components with precision provides an invaluable opportunity for parsing out key molecular determinants of neuronal function. Fluorescence-based immunolabeling is a sensitive method for morphological and molecular characterization of fine structures in neurons. Yet, even when combined with confocal microscopy, detection of AIS elements with immunofluorescence has been limited by the loss of antigenicity caused by fixative materials. This technical barrier has posed significant limitations in detecting AIS components alone or in combination with other markers. Here, we designed improved protocols targeted to confocal immunofluorescence detection of the AIS marker fibroblast growth factor 14 (FGF14) in combination with the cytoskeletal-associated protein Ankyrin-G, the scaffolding protein βIV-spectrin, voltage-gated Na⁺ (Nav) channels (especially the Nav1.6 isoform) and critical cell type-specific neuronal markers such as parvalbumin, calbindin, and NeuN in the mouse brain. Notably, we demonstrate that intracardiac perfusion of animals with a commercially available solution containing 1% formaldehyde and 0.5% methanol, followed by brief fixation with cold acetone is an optimal and sensitive protocol for FGF14 and other AIS marker detection that guarantees excellent tissue integrity. With variations in the procedure, we also significantly improved the detection of Nav1.6, a Nav isoform known for its fixative-sensitivity. Overall, this study provides an ensemble of immunohistochemical recipes that permit excellent staining of otherwise invisible molecules within well-preserved tissue architecture. While improving the specific investigation of AIS physiology and cell biology, our thorough study can also serve as a roadmap for optimizing immunodetection of other fixative-sensitive proteins expanding the repertoire of enabling methods for brain studies.