Feasibility of 3D Reconstruction of Neural Morphology Using Expansion Microscopy and Barcode-Guided Agglomeration

Automated Analysis of Neuronal Morphology in 2D Fluorescence Micrographs through an Unsupervised Semantic Segmentation of Neurons

Brain function emerges from a highly complex network of specialized cells that are interlinked by billions of synapses. The synaptic connectivity between neurons is established between the elongated processes of their axons and dendrites or, together, neurites. To establish these connections, cellular neurites have to grow in highly specialized, cell-type dependent patterns covering extensive distances and connecting with thousands of other neurons. The outgrowth and branching of neurites are tightly controlled during development and are a commonly used functional readout of imaging in the neurosciences. Manual analysis of neuronal morphology from microscopy images, however, is very time intensive and prone to bias. Most automated analyses of neurons rely on reconstruction of the neuron as a whole without a semantic analysis of each neurite. A fully-automated classification of all neurites still remains unavailable in open-source software. Here we present a standalone, GUI-based software for batch-quantification of neuronal morphology in two-dimensional fluorescence micrographs of cultured neurons with minimal requirements for user interaction. Single neurons are first reconstructed into binarized images using a Hessian-based segmentation algorithm to detect thin neurite structures combined with intensity- and shape-based reconstruction of the cell body. Neurites are then classified into axon, dendrites and their branches of increasing order using a geodesic distance transform of the cell skeleton. The software was benchmarked against a published dataset and reproduced the phenotype observed after manual annotation. Our tool promises accelerated and improved morphometric studies of neuronal morphology by allowing for consistent and automated analysis of large datasets.

Blind demixing methods for recovering dense neuronal morphology from barcode imaging data

Cellular barcoding methods offer the exciting possibility of 'infinite-pseudocolor' anatomical reconstruction-i.e., assigning each neuron its own random unique barcoded 'pseudocolor,' and then using these pseudocolors to trace the microanatomy of each neuron. Here we use simulations, based on densely-reconstructed electron microscopy microanatomy, with signal structure matched to real barcoding data, to quantify the feasibility of this procedure. We develop a new blind demixing approach to recover the barcodes that label each neuron, and validate this method on real data with known barcodes. We also develop a neural network which uses the recovered barcodes to reconstruct the neuronal morphology from the observed fluorescence imaging data, 'connecting the dots' between discontiguous barcode amplicon signals. We find that accurate recovery should be feasible, provided that the barcode signal density is sufficiently high. This study suggests the possibility of mapping the morphology and projection pattern of many individual neurons simultaneously, at high resolution and at large scale, via conventional light microscopy.

Advanced Technologies for Local Neural Circuits in the Cerebral Cortex

The neural network in the brain can be viewed as an integrated system assembled from a large number of local neural circuits specialized for particular brain functions. Activities of neurons in local neural circuits are thought to be organized both spatially and temporally under the rules optimized for their roles in information processing. It is well perceived that different areas of the mammalian neocortex have specific cognitive functions and distinct computational properties. However, the organizational principles of the local neural circuits in different cortical regions have not yet been clarified. Therefore, new research principles and related neuro-technologies that enable efficient and precise recording of large-scale neuronal activities and synaptic connections are necessary. Innovative technologies for structural analysis, including tissue clearing and expansion microscopy, have enabled super resolution imaging of the neural circuits containing thousands of neurons at a single synapse resolution. The imaging resolution and volume achieved by new technologies are beyond the limits of conventional light or electron microscopic methods. Progress in genome editing and related technologies has made it possible to label and manipulate specific cell types and discriminate activities of multiple cell types. These technologies will provide a breakthrough for multiscale analysis of the structure and function of local neural circuits. This review summarizes the basic concepts and practical applications of the emerging technologies and new insight into local neural circuits obtained by these technologies.

Fast deep neural correspondence for tracking and identifying neurons in C. elegans using semi-synthetic training

We present an automated method to track and identify neurons in C. elegans, called 'fast Deep Neural Correspondence' or fDNC, based on the transformer network architecture. The model is trained once on empirically derived semi-synthetic data and then predicts neural correspondence across held-out real animals. The same pre-trained model both tracks neurons across time and identifies corresponding neurons across individuals. Performance is evaluated against hand-annotated datasets, including NeuroPAL (Yemini et al., 2021). Using only position information, the method achieves 79.1% accuracy at tracking neurons within an individual and 64.1% accuracy at identifying neurons across individuals. Accuracy at identifying neurons across individuals is even higher (78.2%) when the model is applied to a dataset published by another group (Chaudhary et al., 2021). Accuracy reaches 74.7% on our dataset when using color information from NeuroPAL. Unlike previous methods, fDNC does not require straightening or transforming the animal into a canonical coordinate system. The method is fast and predicts correspondence in 10 ms making it suitable for future real-time applications.

What would a synthetic connectome look like?

A major challenge of contemporary neuroscience is to unravel the structure of the connectome, the ensemble of neural connections that link between different functional units of the brain, and to reveal how this structure relates to brain function. This thriving area of research largely follows the general tradition in biology of reverse-engineering, which consists of first observing and characterizing a biological system or process, and then deconstructing it into its fundamental building blocks in order to infer its modes of operation. However, a complementary form of biology has emerged, synthetic biology, which emphasizes construction-based forward-engineering. The synthetic biology approach comprises the assembly of new biological systems out of elementary biological parts. The rationale is that the act of building a system can be a powerful method for gaining deep understanding of how that system works. As the fields of connectomics and synthetic biology are independently growing, I propose to consider the benefits of combining the two, to create synthetic connectomics, a new form of neuroscience and a new form of synthetic biology. The goal of synthetic connectomics would be to artificially design and construct the connectomes of live behaving organisms. Synthetic connectomics could serve as a unifying platform for unraveling the complexities of brain operation and perhaps also for generating new forms of artificial life, and, in general, could provide a valuable opportunity for empirically exploring theoretical predictions about network function. What would a synthetic connectome look like? What purposes would it serve? How could it be constructed? This review delineates the novel notion of a synthetic connectome and aims to lay out the initial steps towards its implementation, contemplating its impact on science and society.

DNA sequencing in high-throughput neuroanatomy

Mapping brain connectivity at single cell resolution is critical for understanding brain structure. For decades, such mapping has been principally approached with microscopy techniques, aiming to visualize neurons and their connections. However, these techniques are often very labor intensive and do not scale well to the complexity of mammalian brains. We recently leveraged the speed and parallelization of DNA sequencing to map the projections of thousands of single neurons in single experiments, and to map cortical mesoscale connectivity in single mice. Here, I review the state of sequencing-based neuroanatomy, and discuss future directions in synaptic connectivity mapping and comparative connectomics.

Generative models and abstractions for large-scale neuroanatomy datasets

Neural datasets are increasing rapidly in both resolution and volume. In neuroanatomy, this trend has been accelerated by innovations in imaging technology. As full datasets are impractical and unnecessary for many applications, it is important to identify abstractions that distill useful features of neural structure, organization, and anatomy. In this review article, we discuss several such abstractions and highlight recent algorithmic advances in working with these models. In particular, we discuss the use of generative models in neuroanatomy; such models may be considered 'meta-abstractions' that capture distributions over other abstractions.

Cortical column and whole-brain imaging with molecular contrast and nanoscale resolution

Optical and electron microscopy have made tremendous inroads toward understanding the complexity of the brain. However, optical microscopy offers insufficient resolution to reveal subcellular details, and electron microscopy lacks the throughput and molecular contrast to visualize specific molecular constituents over millimeter-scale or larger dimensions. We combined expansion microscopy and lattice light-sheet microscopy to image the nanoscale spatial relationships between proteins across the thickness of the mouse cortex or the entire Drosophila brain. These included synaptic proteins at dendritic spines, myelination along axons, and presynaptic densities at dopaminergic neurons in every fly brain region. The technology should enable statistically rich, large-scale studies of neural development, sexual dimorphism, degree of stereotypy, and structural correlations to behavior or neural activity, all with molecular contrast.

Expansion microscopy: principles and uses in biological research

Many biological investigations require 3D imaging of cells or tissues with nanoscale spatial resolution. We recently discovered that preserved biological specimens can be physically expanded in an isotropic fashion through a chemical process. Expansion microscopy (ExM) allows nanoscale imaging of biological specimens with conventional microscopes, decrowds biomolecules in support of signal amplification and multiplexed readout chemistries, and makes specimens transparent. We review the principles of how ExM works, advances in the technology made by our group and others, and its applications throughout biology and medicine.

Progress and remaining challenges in high-throughput volume electron microscopy

Recent advances in the effectiveness of the automatic extraction of neural circuits from volume electron microscopy data have made us more optimistic that the goal of reconstructing the nervous system of an entire adult mammal (or bird) brain can be achieved in the next decade. The progress on the data analysis side-based mostly on variants of convolutional neural networks-has been particularly impressive, but improvements in the quality and spatial extent of published VEM datasets are substantial. Methodologically, the combination of hot-knife sample partitioning and ion milling stands out as a conceptual advance while the multi-beam scanning electron microscope promises to remove the data-acquisition bottleneck.