Convergent Temperature Representations in Artificial and Biological Neural Networks

Vertebrate behavioral thermoregulation: knowledge and future directions

Thermoregulation is critical for survival across species. In animals, the nervous system detects external and internal temperatures, integrates this information with internal states, and ultimately forms a decision on appropriate thermoregulatory actions. Recent work has identified critical molecules and sensory and motor pathways controlling thermoregulation. However, especially with regard to behavioral thermoregulation, many open questions remain. Here, we aim to both summarize the current state of research, the "knowledge," as well as what in our mind is still largely missing, the "future directions." Given the host of circuit entry points that have been discovered, we specifically see that the time is ripe for a neuro-computational perspective on thermoregulation. Such a perspective is largely lacking but is increasingly fueled and made possible by the development of advanced tools and modeling strategies.

Task-driven neural network models predict neural dynamics of proprioception

Proprioception tells the brain the state of the body based on distributed sensory neurons. Yet, the principles that govern proprioceptive processing are poorly understood. Here, we employ a task-driven modeling approach to investigate the neural code of proprioceptive neurons in cuneate nucleus (CN) and somatosensory cortex area 2 (S1). We simulated muscle spindle signals through musculoskeletal modeling and generated a large-scale movement repertoire to train neural networks based on 16 hypotheses, each representing different computational goals. We found that the emerging, task-optimized internal representations generalize from synthetic data to predict neural dynamics in CN and S1 of primates. Computational tasks that aim to predict the limb position and velocity were the best at predicting the neural activity in both areas. Since task optimization develops representations that better predict neural activity during active than passive movements, we postulate that neural activity in the CN and S1 is top-down modulated during goal-directed movements.

Bayesian inference is facilitated by modular neural networks with different time scales

Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.

Contrasting action and posture coding with hierarchical deep neural network models of proprioception

Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body's state. The canonical role of proprioception is representing the body state. We hypothesize that the proprioceptive system could also be critical for high-level tasks such as action recognition. To test this theory, we pursued a task-driven modeling approach, which allowed us to isolate the study of proprioception. We generated a large synthetic dataset of human arm trajectories tracing characters of the Latin alphabet in 3D space, together with muscle activities obtained from a musculoskeletal model and model-based muscle spindle activity. Next, we compared two classes of tasks: trajectory decoding and action recognition, which allowed us to train hierarchical models to decode either the position and velocity of the end-effector of one's posture or the character (action) identity from the spindle firing patterns. We found that artificial neural networks could robustly solve both tasks, and the networks' units show tuning properties similar to neurons in the primate somatosensory cortex and the brainstem. Remarkably, we found uniformly distributed directional selective units only with the action-recognition-trained models and not the trajectory-decoding-trained models. This suggests that proprioceptive encoding is additionally associated with higher-level functions such as action recognition and therefore provides new, experimentally testable hypotheses of how proprioception aids in adaptive motor control.

From calcium imaging to graph topology

Systems neuroscience is facing an ever-growing mountain of data. Recent advances in protein engineering and microscopy have together led to a paradigm shift in neuroscience; using fluorescence, we can now image the activity of every neuron through the whole brain of behaving animals. Even in larger organisms, the number of neurons that we can record simultaneously is increasing exponentially with time. This increase in the dimensionality of the data is being met with an explosion of computational and mathematical methods, each using disparate terminology, distinct approaches, and diverse mathematical concepts. Here we collect, organize, and explain multiple data analysis techniques that have been, or could be, applied to whole-brain imaging, using larval zebrafish as an example model. We begin with methods such as linear regression that are designed to detect relations between two variables. Next, we progress through network science and applied topological methods, which focus on the patterns of relations among many variables. Finally, we highlight the potential of generative models that could provide testable hypotheses on wiring rules and network progression through time, or disease progression. While we use examples of imaging from larval zebrafish, these approaches are suitable for any population-scale neural network modeling, and indeed, to applications beyond systems neuroscience. Computational approaches from network science and applied topology are not limited to larval zebrafish, or even to systems neuroscience, and we therefore conclude with a discussion of how such methods can be applied to diverse problems across the biological sciences.

How learning unfolds in the brain: toward an optimization view

How do changes in the brain lead to learning? To answer this question, consider an artificial neural network (ANN), where learning proceeds by optimizing a given objective or cost function. This "optimization framework" may provide new insights into how the brain learns, as many idiosyncratic features of neural activity can be recapitulated by an ANN trained to perform the same task. Nevertheless, there are key features of how neural population activity changes throughout learning that cannot be readily explained in terms of optimization and are not typically features of ANNs. Here we detail three of these features: (1) the inflexibility of neural variability throughout learning, (2) the use of multiple learning processes even during simple tasks, and (3) the presence of large task-nonspecific activity changes. We propose that understanding the role of these features in the brain will be key to describing biological learning using an optimization framework.

Predicting individual neuron responses with anatomically constrained task optimization

Artificial neural networks trained to solve sensory tasks can develop statistical representations that match those in biological circuits. However, it remains unclear whether they can reproduce properties of individual neurons. Here, we investigated how artificial networks predict individual neuron properties in the visual motion circuits of the fruit fly Drosophila. We trained anatomically constrained networks to predict movement in natural scenes, solving the same inference problem as fly motion detectors. Units in the artificial networks adopted many properties of analogous individual neurons, even though they were not explicitly trained to match these properties. Among these properties was the split into ON and OFF motion detectors, which is not predicted by classical motion detection models. The match between model and neurons was closest when models were trained to be robust to noise. These results demonstrate how anatomical, task, and noise constraints can explain properties of individual neurons in a small neural network.

Measuring and modeling the motor system with machine learning

The utility of machine learning in understanding the motor system is promising a revolution in how to collect, measure, and analyze data. The field of movement science already elegantly incorporates theory and engineering principles to guide experimental work, and in this review we discuss the growing use of machine learning: from pose estimation, kinematic analyses, dimensionality reduction, and closed-loop feedback, to its use in understanding neural correlates and untangling sensorimotor systems. We also give our perspective on new avenues, where markerless motion capture combined with biomechanical modeling and neural networks could be a new platform for hypothesis-driven research.

Theoretical principles for illuminating sensorimotor processing with brain-wide neuronal recordings

Modern recording techniques now permit brain-wide sensorimotor circuits to be observed at single neuron resolution in small animals. Extracting theoretical understanding from these recordings requires principles that organize findings and guide future experiments. Here we review theoretical principles that shed light onto brain-wide sensorimotor processing. We begin with an analogy that conceptualizes principles as streetlamps that illuminate the empirical terrain, and we illustrate the analogy by showing how two familiar principles apply in new ways to brain-wide phenomena. We then focus the bulk of the review on describing three more principles that have wide utility for mapping brain-wide neural activity, making testable predictions from highly parameterized mechanistic models, and investigating the computational determinants of neuronal response patterns across the brain.

Thermoregulation in fish

Thermoregulation is critical for survival and animals therefore employ strategies to keep their body temperature within a physiological range. As ectotherms, fish exclusively rely on behavioral strategies for thermoregulation. Different species of fish seek out their specific optimal temperatures through thermal navigation by biasing behavioral output based on experienced environmental temperatures. Like other vertebrates, fish sense water temperature using thermoreceptors in trigeminal and dorsal root ganglia neurons that innervate the skin. Recent research in larval zebrafish has revealed how neural circuits subsequently transform this sensation of temperature into thermoregulatory behaviors. Across fish species, thermoregulatory strategies rely on a modulation of swim vigor based on current temperature and a modulation of turning based on temperature change. Interestingly, temperature preferences are not fixed but depend on other environmental cues and internal states. The following review is intended as an overview on the current knowledge as well as open questions in fish thermoregulation.

Whole-brain interactions underlying zebrafish behavior

Detailed quantification of neural dynamics across the entire brain will be the key to genuinely understanding perception and behavior. With the recent developments in microscopy and biosensor engineering, the zebrafish has made a grand entrance in neuroscience as its small size and optical transparency enable imaging access to its entire brain at cellular and even subcellular resolution. However, until recently many neurobiological insights were largely correlational or provided little mechanistic insight into the brain-wide population dynamics generated by diverse types of neurons. Now with increasingly sophisticated behavioral, imaging, and causal intervention paradigms, zebrafish are revealing how entire vertebrate brains function. Here we review recent research that fulfills promises made by the early wave of technical advances. These studies reveal new features of brain-wide neural processing and the importance of integrative investigation and computational modelling. Moreover, we outline the future tools necessary for solving broader brain-scale circuit problems.

Zebrafish Neuroscience: Using Artificial Neural Networks to Help Understand Brains

Brains are notoriously hard to understand, and neuroscientists need all the tools they can get their hands on to have a realistic shot at it. Advances in machine learning are proving instrumental, illustrated by their recent use to shed light on navigational strategies implemented by zebrafish brains.

Harnessing behavioral diversity to understand neural computations for cognition

With the increasing acquisition of large-scale neural recordings comes the challenge of inferring the computations they perform and understanding how these give rise to behavior. Here, we review emerging conceptual and technological advances that begin to address this challenge, garnering insights from both biological and artificial neural networks. We argue that neural data should be recorded during rich behavioral tasks, to model cognitive processes and estimate latent behavioral variables. Careful quantification of animal movements can also provide a more complete picture of how movements shape neural dynamics and reflect changes in brain state, such as arousal or stress. Artificial neural networks (ANNs) could serve as artificial model organisms to connect neural dynamics and rich behavioral data. ANNs have already begun to reveal how a wide range of different behaviors can be implemented, generating hypotheses about how observed neural activity might drive behavior and explaining diversity in behavioral strategies.