1
|
Tekriwal A, Baker S, Christensen E, Petersen-Jones H, Tien RN, Ojemann SG, Kern DS, Kramer DR, Felsen G, Thompson JA. Quantifying neuro-motor correlations during awake deep brain stimulation surgery using markerless tracking. Sci Rep 2022; 12:18120. [PMID: 36302865 PMCID: PMC9613670 DOI: 10.1038/s41598-022-21860-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 10/04/2022] [Indexed: 12/30/2022] Open
Abstract
The expanding application of deep brain stimulation (DBS) therapy both drives and is informed by our growing understanding of disease pathophysiology and innovations in neurosurgical care. Neurophysiological targeting, a mainstay for identifying optimal, motor responsive targets, has remained largely unchanged for decades. Utilizing deep learning-based computer vision and related computational methods, we developed an effective and simple intraoperative approach to objectively correlate neural signals with movements, automating and standardizing the otherwise manual and subjective process of identifying ideal DBS electrode placements. Kinematics are extracted from video recordings of intraoperative motor testing using a trained deep neural network and compared to multi-unit activity recorded from the subthalamic nucleus. Neuro-motor correlations were quantified using dynamic time warping with the strength of a given comparison measured by comparing against a null distribution composed of related neuro-motor correlations. This objective measure was then compared to clinical determinations as recorded in surgical case notes. In seven DBS cases for treatment of Parkinson's disease, 100 distinct motor testing epochs were extracted for which clear clinical determinations were made. Neuro-motor correlations derived by our automated system compared favorably with expert clinical decision making in post-hoc comparisons, although follow-up studies are necessary to determine if improved correlation detection leads to improved outcomes. By improving the classification of neuro-motor relationships, the automated system we have developed will enable clinicians to maximize the therapeutic impact of DBS while also providing avenues for improving continued care of treated patients.
Collapse
Affiliation(s)
- Anand Tekriwal
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XDepartment of Physiology and Biophysics, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XNeuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XMedical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO 80045 USA
| | - Sunderland Baker
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA
| | - Elijah Christensen
- grid.430503.10000 0001 0703 675XDepartment of Physiology and Biophysics, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XNeuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XMedical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO 80045 USA
| | - Humphrey Petersen-Jones
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XNeuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XMedical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO 80045 USA
| | - Rex N. Tien
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA
| | - Steven G. Ojemann
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA
| | - Drew S. Kern
- grid.430503.10000 0001 0703 675XDepartment of Neurology, University of Colorado School of Medicine, Aurora, CO 80045 USA
| | - Daniel R. Kramer
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA
| | - Gidon Felsen
- grid.430503.10000 0001 0703 675XDepartment of Physiology and Biophysics, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XNeuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XMedical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO 80045 USA
| | - John A. Thompson
- grid.430503.10000 0001 0703 675XDepartment of Neurosurgery, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XDepartment of Physiology and Biophysics, University of Colorado School of Medicine, 12800 E. 19th Ave., Mail Stop 8307, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XNeuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XMedical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO 80045 USA ,grid.430503.10000 0001 0703 675XDepartment of Neurology, University of Colorado School of Medicine, Aurora, CO 80045 USA
| |
Collapse
|
2
|
Burkhart MC, Brandman DM, Franco B, Hochberg LR, Harrison MT. The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models. Neural Comput 2020; 32:969-1017. [PMID: 32187000 PMCID: PMC8259355 DOI: 10.1162/neco_a_01275] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The Kalman filter provides a simple and efficient algorithm to compute the posterior distribution for state-space models where both the latent state and measurement models are linear and gaussian. Extensions to the Kalman filter, including the extended and unscented Kalman filters, incorporate linearizations for models where the observation model p ( observation | state ) is nonlinear. We argue that in many cases, a model for p ( state | observation ) proves both easier to learn and more accurate for latent state estimation. Approximating p ( state | observation ) as gaussian leads to a new filtering algorithm, the discriminative Kalman filter (DKF), which can perform well even when p ( observation | state ) is highly nonlinear and/or nongaussian. The approximation, motivated by the Bernstein-von Mises theorem, improves as the dimensionality of the observations increases. The DKF has computational complexity similar to the Kalman filter, allowing it in some cases to perform much faster than particle filters with similar precision, while better accounting for nonlinear and nongaussian observation models than Kalman-based extensions. When the observation model must be learned from training data prior to filtering, off-the-shelf nonlinear and nonparametric regression techniques can provide a gaussian model for p ( observation | state ) that cleanly integrates with the DKF. As part of the BrainGate2 clinical trial, we successfully implemented gaussian process regression with the DKF framework in a brain-computer interface to provide real-time, closed-loop cursor control to a person with a complete spinal cord injury. In this letter, we explore the theory underlying the DKF, exhibit some illustrative examples, and outline potential extensions.
Collapse
Affiliation(s)
- Michael C Burkhart
- Division of Applied Mathematics, Brown University, Providence, RI 02912, U.S.A.
| | - David M Brandman
- Department of Neuroscience, Brown University, Providence, RI 02912, U.S.A., and Department of Surgery (Neurosurgery), Dalhousie University, Halifax, NS, B3H 4R2, Canada
| | - Brian Franco
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA 02114, U.S.A.
| | - Leigh R Hochberg
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA 02114, U.S.A.; School of Engineering and Carney Institute for Brain Science, Brown University, Providence, RI 02912, U.S.A.; Neurology, Harvard Medical School, Boston, MA 02115, U.S.A.; and VA RR&D Center for Neurorestoration and Neurotechnology, Providence Veterans Affairs Medical Center, Providence, RI 02908, U.S.A.
| | - Matthew T Harrison
- Division of Applied Mathematics, Brown University, Providence, RI 02912, U.S.A.
| |
Collapse
|
3
|
Brandman DM, Hosman T, Saab J, Burkhart MC, Shanahan BE, Ciancibello JG, Sarma AA, Milstein DJ, Vargas-Irwin CE, Franco B, Kelemen J, Blabe C, Murphy BA, Young DR, Willett FR, Pandarinath C, Stavisky SD, Kirsch RF, Walter BL, Bolu Ajiboye A, Cash SS, Eskandar EN, Miller JP, Sweet JA, Shenoy KV, Henderson JM, Jarosiewicz B, Harrison MT, Simeral JD, Hochberg LR. Rapid calibration of an intracortical brain-computer interface for people with tetraplegia. J Neural Eng 2019; 15:026007. [PMID: 29363625 DOI: 10.1088/1741-2552/aa9ee7] [Citation(s) in RCA: 63] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Brain-computer interfaces (BCIs) can enable individuals with tetraplegia to communicate and control external devices. Though much progress has been made in improving the speed and robustness of neural control provided by intracortical BCIs, little research has been devoted to minimizing the amount of time spent on decoder calibration. APPROACH We investigated the amount of time users needed to calibrate decoders and achieve performance saturation using two markedly different decoding algorithms: the steady-state Kalman filter, and a novel technique using Gaussian process regression (GP-DKF). MAIN RESULTS Three people with tetraplegia gained rapid closed-loop neural cursor control and peak, plateaued decoder performance within 3 min of initializing calibration. We also show that a BCI-naïve user (T5) was able to rapidly attain closed-loop neural cursor control with the GP-DKF using self-selected movement imagery on his first-ever day of closed-loop BCI use, acquiring a target 37 s after initiating calibration. SIGNIFICANCE These results demonstrate the potential for an intracortical BCI to be used immediately after deployment by people with paralysis, without the need for user learning or extensive system calibration.
Collapse
Affiliation(s)
- David M Brandman
- Neuroscience Graduate Program, Brown University, Providence, RI, United States of America. Department of Neuroscience, Brown University, Providence, RI, United States of America. Brown Institute for Brain Science, Brown University, Providence, RI, United States of America. Department of Surgery (Neurosurgery), Dalhousie University, Halifax, NS, Canada
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
4
|
Brandman DM, Burkhart MC, Kelemen J, Franco B, Harrison MT, Hochberg LR. Robust Closed-Loop Control of a Cursor in a Person with Tetraplegia using Gaussian Process Regression. Neural Comput 2018; 30:2986-3008. [PMID: 30216140 DOI: 10.1162/neco_a_01129] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
Intracortical brain computer interfaces can enable individuals with paralysis to control external devices through voluntarily modulated brain activity. Decoding quality has been previously shown to degrade with signal nonstationarities-specifically, the changes in the statistics of the data between training and testing data sets. This includes changes to the neural tuning profiles and baseline shifts in firing rates of recorded neurons, as well as nonphysiological noise. While progress has been made toward providing long-term user control via decoder recalibration, relatively little work has been dedicated to making the decoding algorithm more resilient to signal nonstationarities. Here, we describe how principled kernel selection with gaussian process regression can be used within a Bayesian filtering framework to mitigate the effects of commonly encountered nonstationarities. Given a supervised training set of (neural features, intention to move in a direction)-pairs, we use gaussian process regression to predict the intention given the neural data. We apply kernel embedding for each neural feature with the standard radial basis function. The multiple kernels are then summed together across each neural dimension, which allows the kernel to effectively ignore large differences that occur only in a single feature. The summed kernel is used for real-time predictions of the posterior mean and variance under a gaussian process framework. The predictions are then filtered using the discriminative Kalman filter to produce an estimate of the neural intention given the history of neural data. We refer to the multiple kernel approach combined with the discriminative Kalman filter as the MK-DKF. We found that the MK-DKF decoder was more resilient to nonstationarities frequently encountered in-real world settings yet provided similar performance to the currently used Kalman decoder. These results demonstrate a method by which neural decoding can be made more resistant to nonstationarities.
Collapse
Affiliation(s)
- David M Brandman
- Neuroscience Graduate Program, Department of Neuroscience, Carney Institute for Brain Science, and School of Engineering, Brown University, Providence, RI 02912, U.S.A.; and Department of Surgery (Neurosurgery), Dalhousie University, Halifax, NS B3H 347 Canada
| | - Michael C Burkhart
- Division of Applied Mathematics, Brown University, Providence, RI 02912, U.S.A.
| | - Jessica Kelemen
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA 02114, U.S.A.
| | - Brian Franco
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA 02114, U.S.A.
| | - Matthew T Harrison
- Division of Applied Mathematics, Brown University, Providence, RI 02912, U.S.A.
| | - Leigh R Hochberg
- Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Department of Veterans Affairs Medical Center, Providence, RI 02908; Carney Institute for Brain Science and School of Engineering, Brown University, Providence, RI 02912; Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA 02114; and Neurology, Harvard Medical School, Boston, MA 02115, U.S.A.
| |
Collapse
|
5
|
Makin JG, O’Doherty JE, Cardoso MMB, Sabes PN. Superior arm-movement decoding from cortex with a new, unsupervised-learning algorithm. J Neural Eng 2018; 15:026010. [DOI: 10.1088/1741-2552/aa9e95] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
6
|
Brandman DM, Cash SS, Hochberg LR. Review: Human Intracortical Recording and Neural Decoding for Brain-Computer Interfaces. IEEE Trans Neural Syst Rehabil Eng 2017; 25:1687-1696. [PMID: 28278476 PMCID: PMC5815832 DOI: 10.1109/tnsre.2017.2677443] [Citation(s) in RCA: 50] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Brain-computer interfaces (BCIs) use neural information recorded from the brain for the voluntary control of external devices. The development of BCI systems has largely focused on improving functional independence for individuals with severe motor impairments, including providing tools for communication and mobility. In this review, we describe recent advances in intracortical BCI technology and provide potential directions for further research.
Collapse
|
7
|
Niketeghad S, Hebb AO, Nedrud J, Hanrahan SJ, Mahoor MH. Motor Task Detection From Human STN Using Interhemispheric Connectivity. IEEE Trans Neural Syst Rehabil Eng 2017; 26:216-223. [PMID: 28945597 DOI: 10.1109/tnsre.2017.2754879] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Deep brain stimulation (DBS) provides significant therapeutic benefit for movement disorders, such as Parkinson's disease (PD). Current DBS devices lack real-time feedback (thus are open loop) and stimulation parameters are adjusted during scheduled visits with a clinician. A closed-loop DBS system may reduce power consumption and side effects by adjusting stimulation parameters based on patient's behavior. Subthalamic nucleus (STN) local field potential (LFP) is a great candidate signal for the neural feedback, because it can be recorded from the stimulation lead and does not require additional sensors. In this paper, we introduce a behavior detection method capable of asynchronously detecting the finger movements of PD patients. Our study indicates that there is a motor-modulated inter-hemispheric connectivity between LFP signals recorded bilaterally from the STN. We utilize a non-linear regression method to measure this inter-hemispheric connectivity for detecting finger movement. Our experimental results, using the recordings from 11 patients with PD, demonstrate that this approach is applicable for behavior detection in the majority of subjects (average area under curve of 70±12%).
Collapse
|