1
|
Sandbrink KJ, Mamidanna P, Michaelis C, Bethge M, Mathis MW, Mathis A. Contrasting action and posture coding with hierarchical deep neural network models of proprioception. eLife 2023; 12:e81499. [PMID: 37254843 PMCID: PMC10361732 DOI: 10.7554/elife.81499] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 05/16/2023] [Indexed: 06/01/2023] Open
Abstract
Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body's state. The canonical role of proprioception is representing the body state. We hypothesize that the proprioceptive system could also be critical for high-level tasks such as action recognition. To test this theory, we pursued a task-driven modeling approach, which allowed us to isolate the study of proprioception. We generated a large synthetic dataset of human arm trajectories tracing characters of the Latin alphabet in 3D space, together with muscle activities obtained from a musculoskeletal model and model-based muscle spindle activity. Next, we compared two classes of tasks: trajectory decoding and action recognition, which allowed us to train hierarchical models to decode either the position and velocity of the end-effector of one's posture or the character (action) identity from the spindle firing patterns. We found that artificial neural networks could robustly solve both tasks, and the networks' units show tuning properties similar to neurons in the primate somatosensory cortex and the brainstem. Remarkably, we found uniformly distributed directional selective units only with the action-recognition-trained models and not the trajectory-decoding-trained models. This suggests that proprioceptive encoding is additionally associated with higher-level functions such as action recognition and therefore provides new, experimentally testable hypotheses of how proprioception aids in adaptive motor control.
Collapse
Affiliation(s)
- Kai J Sandbrink
- The Rowland Institute at Harvard, Harvard UniversityCambridgeUnited States
| | - Pranav Mamidanna
- Tübingen AI Center, Eberhard Karls Universität Tübingen & Institute for Theoretical PhysicsTübingenGermany
| | - Claudio Michaelis
- Tübingen AI Center, Eberhard Karls Universität Tübingen & Institute for Theoretical PhysicsTübingenGermany
| | - Matthias Bethge
- Tübingen AI Center, Eberhard Karls Universität Tübingen & Institute for Theoretical PhysicsTübingenGermany
| | - Mackenzie Weygandt Mathis
- The Rowland Institute at Harvard, Harvard UniversityCambridgeUnited States
- Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de LausanneGenèveSwitzerland
| | - Alexander Mathis
- The Rowland Institute at Harvard, Harvard UniversityCambridgeUnited States
- Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de LausanneGenèveSwitzerland
| |
Collapse
|
2
|
Mo F, Zhang Q, Zhang H, Long J, Wang Y, Chen G, Ye J. A simulation-based framework with a proprioceptive musculoskeletal model for evaluating the rehabilitation exoskeleton system. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106270. [PMID: 34271263 DOI: 10.1016/j.cmpb.2021.106270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Accepted: 07/01/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Various rehabilitation exoskeletons have been designed to help people regain normal gait from stroke effects. However, the evaluation and further optimization of these exoskeletons are not convenient and usually need complicated experimental works. The present study aims to establish a simulation-based method with a proprioceptive musculoskeletal model to conveniently evaluate the efficiency of a self-developed exoskeleton for further optimization. METHODS Three volunteers who suffer from dyskinesia due to stroke were recruited for gait experiments with and without the self-develop exoskeleton. The corresponding simulations were implemented based on the proprioceptive model, the exoskeleton model, and the input kinematic data obtained from the experiments. The joint angles, muscle activations, and metabolic costs as well as the proprioceptor feedback stimulation were extracted for comparative analysis. RESULT Several positive effects of the exoskeleton were noted based on the simulation results when using it to aid the patients' rehabilitation during the gait training. The CORA scores of the patients' joint angle to the normal data increased by 11.6~37.8% with the assistance of the exoskeleton. The wave frequency of proprioceptive feedback stimulation that can be directly correlated to the neural rehabilitation obviously inclined during a gait cycle. The muscle activations were also rearranged to better support the patient's walk when using the exoskeleton, while the metabolic costs were reduced for all the patients. CONCLUSION In summary, the present simulation-based method can be practical for pre-evaluation and optimization of various exoskeleton design in the future.
Collapse
Affiliation(s)
- Fuhao Mo
- State Key Laboratory of Advanced Design and Manufacture for Vehicle Body, Hunan University, Changsha, Hunan 410082, China.
| | - Qiang Zhang
- State Key Laboratory of Advanced Design and Manufacture for Vehicle Body, Hunan University, Changsha, Hunan 410082, China.
| | - Haotian Zhang
- State Key Laboratory of Advanced Design and Manufacture for Vehicle Body, Hunan University, Changsha, Hunan 410082, China.
| | - Jianjun Long
- Rehabilitation Center, Shenzhen University First Affiliated Hospital, Shenzhen, Guangdong 518000, China.
| | - Yulong Wang
- Rehabilitation Center, Shenzhen University First Affiliated Hospital, Shenzhen, Guangdong 518000, China.
| | - Gong Chen
- MileBot Robotics Co., Ltd, Shenzhen, Guangdong 518000, China; Shenzhen Institute of Geriatrics, Shenzhen University, Shenzhen, Guangdong 518000, China.
| | - Jing Ye
- MileBot Robotics Co., Ltd, Shenzhen, Guangdong 518000, China; Shenzhen Institute of Geriatrics, Shenzhen University, Shenzhen, Guangdong 518000, China.
| |
Collapse
|
3
|
Dallmann CJ, Karashchuk P, Brunton BW, Tuthill JC. A leg to stand on: computational models of proprioception. CURRENT OPINION IN PHYSIOLOGY 2021; 22:100426. [PMID: 34595361 PMCID: PMC8478261 DOI: 10.1016/j.cophys.2021.03.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Dexterous motor control requires feedback from proprioceptors, internal mechanosensory neurons that sense the body's position and movement. An outstanding question in neuroscience is how diverse proprioceptive feedback signals contribute to flexible motor control. Genetic tools now enable targeted recording and perturbation of proprioceptive neurons in behaving animals; however, these experiments can be challenging to interpret, due to the tight coupling of proprioception and motor control. Here, we argue that understanding the role of proprioceptive feedback in controlling behavior will be aided by the development of multiscale models of sensorimotor loops. We review current phenomenological and structural models for proprioceptor encoding and discuss how they may be integrated with existing models of posture, movement, and body state estimation.
Collapse
Affiliation(s)
- Chris J Dallmann
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Pierre Karashchuk
- Neuroscience Graduate Program, University of Washington, Seattle, WA, USA
| | - Bingni W Brunton
- Department of Biology, University of Washington, Seattle, WA, USA
| | - John C Tuthill
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| |
Collapse
|
4
|
Greiner N, Barra B, Schiavone G, Lorach H, James N, Conti S, Kaeser M, Fallegger F, Borgognon S, Lacour S, Bloch J, Courtine G, Capogrosso M. Recruitment of upper-limb motoneurons with epidural electrical stimulation of the cervical spinal cord. Nat Commun 2021; 12:435. [PMID: 33469022 PMCID: PMC7815834 DOI: 10.1038/s41467-020-20703-1] [Citation(s) in RCA: 67] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2020] [Accepted: 12/16/2020] [Indexed: 12/21/2022] Open
Abstract
Epidural electrical stimulation (EES) of lumbosacral sensorimotor circuits improves leg motor control in animals and humans with spinal cord injury (SCI). Upper-limb motor control involves similar circuits, located in the cervical spinal cord, suggesting that EES could also improve arm and hand movements after quadriplegia. However, the ability of cervical EES to selectively modulate specific upper-limb motor nuclei remains unclear. Here, we combined a computational model of the cervical spinal cord with experiments in macaque monkeys to explore the mechanisms of upper-limb motoneuron recruitment with EES and characterize the selectivity of cervical interfaces. We show that lateral electrodes produce a segmental recruitment of arm motoneurons mediated by the direct activation of sensory afferents, and that muscle responses to EES are modulated during movement. Intraoperative recordings suggested similar properties in humans at rest. These modelling and experimental results can be applied for the development of neurotechnologies designed for the improvement of arm and hand control in humans with quadriplegia. The efficacy of epidural electrical stimulation (EES) to engage arm muscles and improve movement after spinal cord injury is still unclear. Here, the authors investigated how EES can recruit upper-limb motor neurons by combining computational modelling with experiments in non-human primates.
Collapse
Affiliation(s)
- Nathan Greiner
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland. .,Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland.
| | - Beatrice Barra
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Giuseppe Schiavone
- Bertarelli Foundation Chair in Neuroprosthetic Technology, Laboratory for Soft Bioelectronics Interface, Institute of Microengineering, Institute of Bioengineering, Centre for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| | - Henri Lorach
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.,Defitech Center for Interventional Neurotherapies (NeuroRestore), Lausanne, Switzerland
| | - Nicholas James
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
| | - Sara Conti
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Melanie Kaeser
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Florian Fallegger
- Bertarelli Foundation Chair in Neuroprosthetic Technology, Laboratory for Soft Bioelectronics Interface, Institute of Microengineering, Institute of Bioengineering, Centre for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| | - Simon Borgognon
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.,Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Stéphanie Lacour
- Bertarelli Foundation Chair in Neuroprosthetic Technology, Laboratory for Soft Bioelectronics Interface, Institute of Microengineering, Institute of Bioengineering, Centre for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| | - Jocelyne Bloch
- Defitech Center for Interventional Neurotherapies (NeuroRestore), Lausanne, Switzerland.,Department of Neurosurgery, Lausanne University Hospital (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Grégoire Courtine
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.,Defitech Center for Interventional Neurotherapies (NeuroRestore), Lausanne, Switzerland.,Department of Neurosurgery, Lausanne University Hospital (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Marco Capogrosso
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland. .,Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA, USA. .,Rehab and Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.
| |
Collapse
|
5
|
Pierella C, Pirondini E, Kinany N, Coscia M, Giang C, Miehlbradt J, Magnin C, Nicolo P, Dalise S, Sgherri G, Chisari C, Van De Ville D, Guggisberg A, Micera S. A multimodal approach to capture post-stroke temporal dynamics of recovery. J Neural Eng 2020; 17:045002. [DOI: 10.1088/1741-2552/ab9ada] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
|