1
|
Tolooshams B, Matias S, Wu H, Temereanca S, Uchida N, Murthy VN, Masset P, Ba D. Interpretable deep learning for deconvolutional analysis of neural signals. Neuron 2025; 113:1151-1168.e13. [PMID: 40081364 PMCID: PMC12006907 DOI: 10.1016/j.neuron.2025.02.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 11/06/2024] [Accepted: 02/09/2025] [Indexed: 03/16/2025]
Abstract
The widespread adoption of deep learning to model neural activity often relies on "black-box" approaches that lack an interpretable connection between neural activity and network parameters. Here, we propose using algorithm unrolling, a method for interpretable deep learning, to design the architecture of sparse deconvolutional neural networks and obtain a direct interpretation of network weights in relation to stimulus-driven single-neuron activity through a generative model. We introduce our method, deconvolutional unrolled neural learning (DUNL), and demonstrate its versatility by applying it to deconvolve single-trial local signals across multiple brain areas and recording modalities. We uncover multiplexed salience and reward prediction error signals from midbrain dopamine neurons, perform simultaneous event detection and characterization in somatosensory thalamus recordings, and characterize the heterogeneity of neural responses in the piriform cortex and across striatum during unstructured, naturalistic experiments. Our work leverages advances in interpretable deep learning to provide a mechanistic understanding of neural activity.
Collapse
Affiliation(s)
- Bahareh Tolooshams
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA; Computing + mathematical sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Sara Matias
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA
| | - Hao Wu
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA
| | - Simona Temereanca
- Carney Institute for Brain Science, Brown University, Providence, RI 02906, USA
| | - Naoshige Uchida
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA; Kempner Institute for the Study of Natural & Artificial Intelligence, Harvard University, Cambridge, MA 02138, USA
| | - Venkatesh N Murthy
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA; Kempner Institute for the Study of Natural & Artificial Intelligence, Harvard University, Cambridge, MA 02138, USA
| | - Paul Masset
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA; Department of Psychology, McGill University, Montréal, QC H3A 1G1, Canada; Mila - Quebec Artificial Intelligence Institute, Montréal, QC H2S 3H1, Canada.
| | - Demba Ba
- Kempner Institute for the Study of Natural & Artificial Intelligence, Harvard University, Cambridge, MA 02138, USA.
| |
Collapse
|
2
|
Tolooshams B, Matias S, Wu H, Temereanca S, Uchida N, Murthy VN, Masset P, Ba D. Interpretable deep learning for deconvolutional analysis of neural signals. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.05.574379. [PMID: 38260512 PMCID: PMC10802267 DOI: 10.1101/2024.01.05.574379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
The widespread adoption of deep learning to build models that capture the dynamics of neural populations is typically based on "black-box" approaches that lack an interpretable link between neural activity and network parameters. Here, we propose to apply algorithm unrolling, a method for interpretable deep learning, to design the architecture of sparse deconvolutional neural networks and obtain a direct interpretation of network weights in relation to stimulus-driven single-neuron activity through a generative model. We characterize our method, referred to as deconvolutional unrolled neural learning (DUNL), and show its versatility by applying it to deconvolve single-trial local signals across multiple brain areas and recording modalities. To exemplify use cases of our decomposition method, we uncover multiplexed salience and reward prediction error signals from midbrain dopamine neurons in an unbiased manner, perform simultaneous event detection and characterization in somatosensory thalamus recordings, and characterize the heterogeneity of neural responses in the piriform cortex and in the striatum during unstructured, naturalistic experiments. Our work leverages the advances in interpretable deep learning to gain a mechanistic understanding of neural activity.
Collapse
Affiliation(s)
- Bahareh Tolooshams
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge MA, 02138
- Computing + Mathematical Sciences, California Institute of Technology, Pasadena, CA, 91125
| | - Sara Matias
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- Department of Molecular and Cellular Biology, Harvard University, Cambridge MA, 02138
| | - Hao Wu
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- Department of Molecular and Cellular Biology, Harvard University, Cambridge MA, 02138
| | - Simona Temereanca
- Carney Institute for Brain Science, Brown University, Providence, RI, 02906
| | - Naoshige Uchida
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- Department of Molecular and Cellular Biology, Harvard University, Cambridge MA, 02138
| | - Venkatesh N. Murthy
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- Department of Molecular and Cellular Biology, Harvard University, Cambridge MA, 02138
| | - Paul Masset
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- Department of Molecular and Cellular Biology, Harvard University, Cambridge MA, 02138
- Department of Psychology, McGill University, Montréal QC, H3A 1G1
| | - Demba Ba
- Center for Brain Science, Harvard University, Cambridge MA, 02138
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge MA, 02138
- Kempner Institute for the Study of Natural & Artificial Intelligence, Harvard University, Cambridge MA, 02138
| |
Collapse
|