1
|
Bandini A, Dousty M, Hitzig SL, Craven BC, Kalsi-Ryan S, Zariffa J. Measuring Hand Use in the Home after Cervical Spinal Cord Injury Using Egocentric Video. J Neurotrauma 2022; 39:1697-1707. [PMID: 35747948 DOI: 10.1089/neu.2022.0156] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
Egocentric video has recently emerged as a potential solution for monitoring hand function in individuals living with tetraplegia in the community, especially for its ability to detect functional use in the home environment. The aim of this study was to develop and validate a wearable vision-based system for measuring hand use in the home among individuals living with tetraplegia. Several deep learning algorithms for detecting functional hand-object interactions were developed and compared. The most accurate algorithm was used to extract measures of hand function from 65 h of unscripted video recorded at home by 20 participants with tetraplegia. These measures were: the percentage of interaction time over total recording time (Perc); the average duration of individual interactions (Dur); and the number of interactions per hour (Num). To demonstrate the clinical validity of the technology, egocentric measures were correlated with validated clinical assessments of hand function and independence (Graded Redefined Assessment of Strength, Sensibility and Prehension [GRASSP], Upper Extremity Motor Score [UEMS], and Spinal Cord Independent Measure [SCIM]). Hand-object interactions were automatically detected with a median F1-score of 0.80 (0.67-0.87). Our results demonstrated that higher UEMS and better prehension were related to greater time spent interacting, whereas higher SCIM and better hand sensation resulted in a higher number of interactions performed during the egocentric video recordings. For the first time, measures of hand function automatically estimated in an unconstrained environment in individuals with tetraplegia have been validated against internationally accepted measures of hand function. Future work will necessitate a formal evaluation of the reliability and responsiveness of the egocentric-based performance measures for hand use.
Collapse
Affiliation(s)
- Andrea Bandini
- KITE Research Institute and Toronto, Ontario, Canada.,The BioRobotics Institute and Scuola Superiore Sant'Anna, Pisa, Italy.,Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Mehdy Dousty
- KITE Research Institute and Toronto, Ontario, Canada.,Institute of Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Sander L Hitzig
- Rehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada.,St. John's Rehab Research Program, Sunnybrook Research Institute, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.,Department of Occupational Science and Occupational Therapy, and University of Toronto, Toronto, Ontario, Canada
| | - B Catharine Craven
- KITE Research Institute and Toronto, Ontario, Canada.,Brain and Spinal Cord Rehabilitation Program Toronto Rehabilitation Institute - University Health Network, Toronto, Ontario, Canada.,Division of Physical Medicine and Rehabilitation Temerty Faculty of Medicine, and University of Toronto, Toronto, Ontario, Canada
| | - Sukhvinder Kalsi-Ryan
- KITE Research Institute and Toronto, Ontario, Canada.,Department of Physical Therapy and University of Toronto, Toronto, Ontario, Canada
| | - José Zariffa
- KITE Research Institute and Toronto, Ontario, Canada.,Institute of Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada.,Rehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada.,Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
2
|
Kubota S, Kadone H, Shimizu Y, Abe T, Makihara T, Kubo T, Watanabe H, Marushima A, Koda M, Hada Y, Yamazaki M. Shoulder training using shoulder assistive robot in a patient with shoulder elevation dysfunction: A case report. J Orthop Sci 2022; 27:1154-1158. [PMID: 32008875 DOI: 10.1016/j.jos.2019.12.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 11/02/2019] [Accepted: 12/22/2019] [Indexed: 11/28/2022]
Affiliation(s)
- Shigeki Kubota
- Department of Orthopaedic Surgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan.
| | - Hideki Kadone
- Center for Innovating Medicine and Engineering (CIME), University of Tsukuba Hospital, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Yukiyo Shimizu
- Department of Rehabilitation Medicine, University of Tsukuba Hospital, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Tetsuya Abe
- Department of Orthopaedic Surgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Takeshi Makihara
- Department of Orthopaedic Surgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Tadashi Kubo
- Department of Rehabilitation Medicine, University of Tsukuba Hospital, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Hiroki Watanabe
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Aiki Marushima
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Masao Koda
- Department of Orthopaedic Surgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Yasushi Hada
- Department of Rehabilitation Medicine, University of Tsukuba Hospital, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| | - Masashi Yamazaki
- Department of Orthopaedic Surgery, Faculty of Medicine, University of Tsukuba, 1-1-1, Tennodai, Tsukuba, Ibaraki, 305-8575, Japan
| |
Collapse
|
3
|
Morone G, de Sire A, Martino Cinnera A, Paci M, Perrero L, Invernizzi M, Lippi L, Agostini M, Aprile I, Casanova E, Marino D, La Rosa G, Bressi F, Sterzi S, Giansanti D, Battistini A, Miccinilli S, Filoni S, Sicari M, Petrozzino S, Solaro CM, Gargano S, Benanti P, Boldrini P, Bonaiuti D, Castelli E, Draicchio F, Falabella V, Galeri S, Gimigliano F, Grigioni M, Mazzoleni S, Mazzon S, Molteni F, Petrarca M, Picelli A, Gandolfi M, Posteraro F, Senatore M, Turchetti G, Straudi S. Upper Limb Robotic Rehabilitation for Patients with Cervical Spinal Cord Injury: A Comprehensive Review. Brain Sci 2021; 11:brainsci11121630. [PMID: 34942935 PMCID: PMC8699455 DOI: 10.3390/brainsci11121630] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 11/29/2021] [Accepted: 11/29/2021] [Indexed: 01/08/2023] Open
Abstract
The upper extremities limitation represents one of the essential functional impairments in patients with cervical spinal cord injury. Electromechanics assisted devices and robots are increasingly used in neurorehabilitation to help functional improvement in patients with neurological diseases. This review aimed to systematically report the evidence-based, state-of-art on clinical applications and robotic-assisted arm training (RAT) in motor and functional recovery in subjects affected by cervical spinal cord injury. The present study has been carried out within the framework of the Italian Consensus Conference on “Rehabilitation assisted by robotic and electromechanical devices for persons with disability of neurological origin” (CICERONE). PubMed/MEDLINE, Cochrane Library, and Physiotherapy Evidence Database (PEDro) databases were systematically searched from inception to September 2021. The 10-item PEDro scale assessed the study quality for the RCT and the AMSTAR-2 for the systematic review. Two different authors rated the studies included in this review. If consensus was not achieved after discussion, a third reviewer was interrogated. The five-item Oxford CEBM scale was used to rate the level of evidence. A total of 11 studies were included. The selected studies were: two systematic reviews, two RCTs, one parallel-group controlled trial, one longitudinal intervention study and five case series. One RCT was scored as a high-quality study, while the systematic review was of low quality. RAT was reported as feasible and safe. Initial positive effects of RAT were found for arm function and quality of movement in addition to conventional therapy. The high clinical heterogeneity of treatment programs and the variety of robot devices could severely affect the generalizability of the study results. Therefore, future studies are warranted to standardize the type of intervention and evaluate the role of robotic-assisted training in subjects affected by cervical spinal cord injury.
Collapse
Affiliation(s)
- Giovanni Morone
- IRCCS Santa Lucia Foundation, 00179 Rome, Italy;
- Correspondence: (G.M.); (A.d.S.); Tel.: +39-0651501005 (G.M.); +39-0961712819 (A.d.S.)
| | - Alessandro de Sire
- Physical and Rehabilitative Medicine, Department of Medical and Surgical Sciences, University of Catanzaro “Magna Graecia”, 88100 Catanzaro, Italy
- Correspondence: (G.M.); (A.d.S.); Tel.: +39-0651501005 (G.M.); +39-0961712819 (A.d.S.)
| | | | - Matteo Paci
- AUSL (Unique Sanitary Local Company), 50123 Florence, Italy;
| | - Luca Perrero
- Neurorehabilitation Unit, Azienda Ospedaliera SS. Antonio e Biagio e Cesare Arrigo, 15121 Alessandria, Italy;
| | - Marco Invernizzi
- Physical and Rehabilitative Medicine, Department of Health Sciences, University of Eastern Piedmont “A. Avogadro”, 10121 Novara, Italy; (M.I.); (L.L.)
- Translational Medicine, Dipartimento Attività Integrate Ricerca e Innovazione (DAIRI), Azienda Ospedaliera Nazionale SS. Antonio e Biagio e Cesare Arrigo, 15121 Alessandria, Italy
| | - Lorenzo Lippi
- Physical and Rehabilitative Medicine, Department of Health Sciences, University of Eastern Piedmont “A. Avogadro”, 10121 Novara, Italy; (M.I.); (L.L.)
| | - Michela Agostini
- Section of Rehabilitation, Department of Neuroscience, University General Hospital of Padova, 35128 Padua, Italy;
| | - Irene Aprile
- IRCCS Fondazione Don Carlo Gnocchi, 50123 Florence, Italy;
| | - Emanuela Casanova
- IRCCS Istituto delle Scienze Neurologiche di Bologna, UOC Medicina Riabilitativa e Neuroriabilitazione, 40139 Bologna, Italy; (E.C.); (A.B.)
| | - Dario Marino
- IRCCS Neurolysis Center “Bonino Pulejo”, 98124 Messina, Italy;
| | - Giuseppe La Rosa
- C.S.R.—Consorzio Siciliano di Riabilitazione, 95123 Catania, Italy;
| | - Federica Bressi
- Campus Bio-Medico University Hospital, University of Rome, 00128 Rome, Italy; (F.B.); (S.S.); (S.M.)
| | - Silvia Sterzi
- Campus Bio-Medico University Hospital, University of Rome, 00128 Rome, Italy; (F.B.); (S.S.); (S.M.)
| | - Daniele Giansanti
- National Center for Innovative Technologies in Public Health, Italian National Institute of Health, 00161 Rome, Italy; (D.G.); (M.G.)
| | - Alberto Battistini
- IRCCS Istituto delle Scienze Neurologiche di Bologna, UOC Medicina Riabilitativa e Neuroriabilitazione, 40139 Bologna, Italy; (E.C.); (A.B.)
| | - Sandra Miccinilli
- Campus Bio-Medico University Hospital, University of Rome, 00128 Rome, Italy; (F.B.); (S.S.); (S.M.)
| | - Serena Filoni
- Padre Pio Foundation and Rehabilitation Center, San Giovanni Rotondo 71013, Italy;
| | - Monica Sicari
- A.O.U. Città della Salute e della Scienza di Torino, 10126 Turin, Italy; (M.S.); (S.P.)
| | - Salvatore Petrozzino
- A.O.U. Città della Salute e della Scienza di Torino, 10126 Turin, Italy; (M.S.); (S.P.)
| | | | | | - Paolo Benanti
- Department of Moral Theology, Pontifical Gregorian University, 00187 Rome, Italy;
| | - Paolo Boldrini
- Società Italiana di Medicina Fisica e Riabilitativa (SIMFER), 00198 Rome, Italy; (P.B.); (D.B.)
| | - Donatella Bonaiuti
- Società Italiana di Medicina Fisica e Riabilitativa (SIMFER), 00198 Rome, Italy; (P.B.); (D.B.)
| | - Enrico Castelli
- Paediatric Neurorehabilitation Department, IRCCS Bambino Gesù Children’s Hospital, 00163 Rome, Italy;
| | - Francesco Draicchio
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00185 Rome, Italy;
| | - Vincenzo Falabella
- Italian Federation of Persons with Spinal Cord Injuries (Faip Onlus), 00195 Rome, Italy;
| | - Silvia Galeri
- IRCCS Fondazione Don Carlo Gnocchi, 20148 Milan, Italy;
| | - Francesca Gimigliano
- Multidisciplinary Department of Medicine for Surgery and Orthodontics, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy;
| | - Mauro Grigioni
- National Center for Innovative Technologies in Public Health, Italian National Institute of Health, 00161 Rome, Italy; (D.G.); (M.G.)
| | - Stefano Mazzoleni
- Department of Electrical and Information Engineering, Politecnico di Bari, 70125 Bari, Italy;
| | - Stefano Mazzon
- AULSS6 (Unique Sanitary Local Company) Euganea Padova, Rehabilitation Department, 35128 Padua, Italy;
| | - Franco Molteni
- Villa Beretta Rehabilitation Center, Department of Rehabilitation Medicine, Valduce Hospital, 23845 Costa Masnaga, Italy;
| | - Maurizio Petrarca
- Movement Analysis and Robotics Laboratory MARlab, IRCCS Bambino Gesù Children’s Hospital, 00163 Rome, Italy;
| | - Alessandro Picelli
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, 37129 Verona, Italy; (A.P.); (M.G.)
| | - Marialuisa Gandolfi
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, 37129 Verona, Italy; (A.P.); (M.G.)
| | - Federico Posteraro
- Rehabilitation Department Versilia Hospital, Versilia Hospital AUSL Toscana Nord Ovest, 55049 Lido di Camaiore, Italy;
| | - Michele Senatore
- AITO (Associazione Italiana Terapisti Occupazionali), 00136 Rome, Italy;
| | - Giuseppe Turchetti
- Management Institute, Sant’Anna School of Advanced Studies, 56127 Pisa, Italy;
| | - Sofia Straudi
- Neuroscience and Rehabilitation Department, Ferrara University Hospital, 44121 Ferrara, Italy;
| |
Collapse
|
4
|
Lightsey HM, Yeung CM, Samartzis D, Makhni MC. The past, present, and future of remote patient monitoring in spine care: an overview. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2021; 30:2102-2108. [PMID: 34241698 DOI: 10.1007/s00586-021-06921-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 04/25/2021] [Accepted: 07/05/2021] [Indexed: 10/20/2022]
Abstract
PURPOSE Remote patient monitoring (RPM) has revolutionized the landscape of healthcare. From humble beginnings rooted in landline home telephone calls to present-day devices with near instantaneous wireless connectivity, the evolution of technology has ushered in an era of digital medicine and remote care. Presently, a vast array of healthcare data points can be automatically generated, analyzed, and forwarded to providers to supplement clinical decision-making. While RPM originated and was popularized within medicine, its role in orthopedics, and particularly within spine surgery, is evolving. We sought to provide an overview of RPM within orthopedics, with specific attention on spine care, analyzing its origins, present-day form, and prospects. METHODS We reviewed the literature to date as it pertains to RPM within healthcare at large, orthopedics, and spine care. RESULTS We detail the development and clinical use of wearable technology and smart implants, examining the underlying technology and evaluating the spectrum of their present-day and potential applications. CONCLUSIONS Technological advancements are not only reshaping the paradigm of musculoskeletal care but are also redefining the physician-patient relationship as well as reimagining traditional perspectives on healthcare data collection and privacy.
Collapse
Affiliation(s)
- Harry M Lightsey
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| | - Caleb M Yeung
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| | - Dino Samartzis
- Department of Orthopaedic Surgery, Rush Medical College, Chicago, IL, USA
| | - Melvin C Makhni
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA.
| |
Collapse
|
5
|
Bandini A, Kalsi-Ryan S, Craven BC, Zariffa J, Hitzig SL. Perspectives and recommendations of individuals with tetraplegia regarding wearable cameras for monitoring hand function at home: Insights from a community-based study. J Spinal Cord Med 2021; 44:S173-S184. [PMID: 33960874 PMCID: PMC8604485 DOI: 10.1080/10790268.2021.1920787] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
CONTEXT Wearable cameras have great potential for producing novel outcome measures of upper limb (UL) function and guiding care in individuals with cervical spinal cord injury (cSCI) living in the community. However, little is known about the perspectives of individuals with cSCI on the potential adoption of this technology. OBJECTIVE To analyze feedback from individuals with cSCI regarding the use of wearable cameras to record daily activities at home, in order to define guidelines for improving the design of this technology and fostering its implementation to optimize UL rehabilitation. DESIGN Mixed-methods study. PARTICIPANTS Thirteen adults with cSCI C3-C8 AIS A-D impairment. MEASURES Interview including survey and semi-structured questions. RESULTS Participants felt that this technology can provide naturalistic information regarding hand use to clinicians and researchers, which in turn can lead to better assessments of UL function and optimized therapies. Participants described the technology as easy-to-use but often reported discomfort that prevented them from conducting long recordings of fully natural activities. Privacy concerns included the possibility to capture household members and personal information displayed on objects (e.g. smartphones). CONCLUSION We provide the first set of guidelines to help researchers and therapists understand which steps need to be taken to translate wearable cameras into outpatient care and community-based research for UL rehabilitation. These guidelines include miniaturized and easy-to-wear cameras, as well as multiple measures for preventing privacy concerns such as avoiding public spaces and providing control over the recordings (e.g. start and stop the recordings at any time, keep or delete a recording).
Collapse
Affiliation(s)
- Andrea Bandini
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network (UHN), Toronto, Ontario, Canada
| | - Sukhvinder Kalsi-Ryan
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network (UHN), Toronto, Ontario, Canada
- Department of Physical Therapy, University of Toronto, Toronto, Ontario, Canada
| | - B. Catharine Craven
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network (UHN), Toronto, Ontario, Canada
- Brain and Spinal Cord Rehabilitation Program, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada
- Division of Physical Medicine and Rehabilitation, Department of Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - José Zariffa
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network (UHN), Toronto, Ontario, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada
- Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada
- Rehabilitation Sciences Institute, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Sander L. Hitzig
- Rehabilitation Sciences Institute, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- St. John’s Rehab Research Program, Sunnybrook Research Institute, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
- Department of Occupational Science & Occupational Therapy, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
6
|
Capturing hand use of individuals with spinal cord injury at home using egocentric video: a feasibility study. Spinal Cord Ser Cases 2021; 7:17. [PMID: 33674553 DOI: 10.1038/s41394-021-00382-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 12/27/2020] [Accepted: 02/10/2021] [Indexed: 11/09/2022] Open
Abstract
STUDY DESIGN Feasibility study. OBJECTIVE The objective of this study is to explore the feasibility of capturing egocentric (first person) video recordings in the home of individuals with cervical spinal cord injury (SCI) for hand function evaluation. SETTING Community-based study in Toronto, Ontario, Canada. METHODS Three participants with SCI recorded activities of daily living (ADLs) at home without the presence of a researcher. Information regarding recording characteristics and compliance was obtained as well as structured and semi-structured interviews involving privacy, usefulness, and usability. A video processing algorithm capable of detecting interactions between the hand and objects was applied to the home recordings. RESULTS In all, 98.58 ± 1.05% of the obtained footage was usable and included four to eight unique activities over a span of 3-7 days. The interaction detection algorithm yielded an F1 score of 0.75 ± 0.15. CONCLUSIONS Capturing ADLs using an egocentric camera in the home environment after SCI is feasible. Considerations regarding privacy, ease of use of the devices, and scheduling of recordings are provided.
Collapse
|
7
|
Abstract
Although patient-reported outcome measures (PROMs) provide valuable insight into the effectiveness of spine surgery, there still remain limitations on measuring outcomes in this manner. Among other deficiencies, PROMs do not always correlate with more objective measures of surgery success. Wearable technology, such as pedometers, tri-axis accelerometer, or wearable cameras, may allow physicians to track patient progress following spine surgery more objectively. Recently, there has been an emphasis on using wearable devices to measure physical activity and limb and spine function. Wearable devices could play an important role as a supplement to PROMs, although they might have to be substantiated through adequate controlled studies to identify normative data for patients presenting with common spine disorders. This review will detail the current state of wearable technology applications in spine surgery and its direction as its utilization expands.
Collapse
|
8
|
Bandini A, Dousty M, Zariffa J. A wearable vision-based system for detecting hand-object interactions in individuals with cervical spinal cord injury: First results in the home environment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:2159-2162. [PMID: 33018434 DOI: 10.1109/embc44109.2020.9176274] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Cervical spinal cord injury (cSCI) causes the paralysis of upper and lower limbs and trunk, significantly reducing quality of life and community participation of the affected individuals. The functional use of the upper limbs is the top recovery priority of people with cSCI and wearable vision-based systems have recently been proposed to extract objective outcome measures that reflect hand function in a natural context. However, previous studies were conducted in a controlled environment and may not be indicative of the actual hand use of people with cSCI living in the community. Thus, we propose a deep learning algorithm for automatically detecting hand-object interactions in egocentric videos recorded by participants with cSCI during their daily activities at home. The proposed approach is able to detect hand-object interactions with good accuracy (F1-score up to 0.82), demonstrating the feasibility of this system in uncontrolled situations (e.g., unscripted activities and variable illumination). This result paves the way for the development of an automated tool for measuring hand function in people with cSCI living in the community.
Collapse
|
9
|
Visee RJ, Likitlersuang J, Zariffa J. An Effective and Efficient Method for Detecting Hands in Egocentric Videos for Rehabilitation Applications. IEEE Trans Neural Syst Rehabil Eng 2020; 28:748-755. [DOI: 10.1109/tnsre.2020.2968912] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
10
|
Schneider S, Popp WL, Brogioli M, Albisser U, Ortmann S, Velstra IM, Demko L, Gassert R, Curt A. Predicting upper limb compensation during prehension tasks in tetraplegic spinal cord injured patients using a single wearable sensor. IEEE Int Conf Rehabil Robot 2019; 2019:1000-1006. [PMID: 31374760 DOI: 10.1109/icorr.2019.8779561] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Upper limb (UL) compensation is a common strategy of patients with a high spinal cord injury (SCI), i.e., tetraplegic patients, to perform activities of daily living (ADLs) despite their sensorimotor deficits. Currently, an objective and sensitive tool to assess UL compensation, which is applicable in the clinical routine and in the daily life of patients, is missing. In this work, we propose a metric to quantify this compensation using a single inertial measurement unit (IMU). The spread of forearm pitch angles of an IMU attached to the wrist of 17 SCI patients and 18 healthy controls performing six prehension tasks of the graded redefined assessment of strength, sensibility and prehension (GRASSP) was extracted. Using the spread of the forearm pitch angles, a classification of UL compensation was possible with very good to excellent accuracies in all six different prehension tasks. Furthermore, the spread of forearm pitch angles correlated moderately to very strongly with qualitative and quantitative GRASSP prehension scores and the task duration. Therefore, we conclude that our proposed method has a high potential to classify compensation accurately and objectively and might be used to quantify the degree of UL compensation in ADLs. Thus, this method could be implemented in clinical trials investigating the effectiveness of interventions targeting UL functions.
Collapse
|
11
|
Likitlersuang J, Sumitro ER, Cao T, Visée RJ, Kalsi-Ryan S, Zariffa J. Egocentric video: a new tool for capturing hand use of individuals with spinal cord injury at home. J Neuroeng Rehabil 2019; 16:83. [PMID: 31277682 PMCID: PMC6612110 DOI: 10.1186/s12984-019-0557-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2019] [Accepted: 06/25/2019] [Indexed: 11/10/2022] Open
Abstract
Background Current upper extremity outcome measures for persons with cervical spinal cord injury (cSCI) lack the ability to directly collect quantitative information in home and community environments. A wearable first-person (egocentric) camera system is presented that aims to monitor functional hand use outside of clinical settings. Methods The system is based on computer vision algorithms that detect the hand, segment the hand outline, distinguish the user’s left or right hand, and detect functional interactions of the hand with objects during activities of daily living. The algorithm was evaluated using egocentric video recordings from 9 participants with cSCI, obtained in a home simulation laboratory. The system produces a binary hand-object interaction decision for each video frame, based on features reflecting motion cues of the hand, hand shape and colour characteristics of the scene. Results The output from the algorithm was compared with a manual labelling of the video, yielding F1-scores of 0.74 ± 0.15 for the left hand and 0.73 ± 0.15 for the right hand. From the resulting frame-by-frame binary data, functional hand use measures were extracted: the amount of total interaction as a percentage of testing time, the average duration of interactions in seconds, and the number of interactions per hour. Moderate and significant correlations were found when comparing these output measures to the results of the manual labelling, with ρ = 0.40, 0.54 and 0.55 respectively. Conclusions These results demonstrate the potential of a wearable egocentric camera for capturing quantitative measures of hand use at home.
Collapse
Affiliation(s)
- Jirapat Likitlersuang
- Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada.,KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada
| | - Elizabeth R Sumitro
- Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada.,KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada
| | - Tianshi Cao
- KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada
| | - Ryan J Visée
- Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada.,KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada
| | - Sukhvinder Kalsi-Ryan
- KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada.,Department of Physical Therapy, University of Toronto, Toronto, Ontario, Canada
| | - José Zariffa
- Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada. .,KITE, Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada.
| |
Collapse
|
12
|
Yozbatiran N, Francisco GE. Robot-assisted Therapy for the Upper Limb after Cervical Spinal Cord Injury. Phys Med Rehabil Clin N Am 2019; 30:367-384. [DOI: 10.1016/j.pmr.2018.12.008] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
13
|
Schneider S, Popp WL, Brogioli M, Albisser U, Demkó L, Debecker I, Velstra IM, Gassert R, Curt A. Reliability of Wearable-Sensor-Derived Measures of Physical Activity in Wheelchair-Dependent Spinal Cord Injured Patients. Front Neurol 2018; 9:1039. [PMID: 30619026 PMCID: PMC6295582 DOI: 10.3389/fneur.2018.01039] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2018] [Accepted: 11/19/2018] [Indexed: 01/20/2023] Open
Abstract
Physical activity (PA) has been shown to have a positive influence on functional recovery in patients after a spinal cord injury (SCI). Hence, it can act as a confounder in clinical intervention studies. Wearable sensors are used to quantify PA in various neurological conditions. However, there is a lack of knowledge about the inter-day reliability of PA measures. The objective of this study was to investigate the single-day reliability of various PA measures in patients with a SCI and to propose recommendations on how many days of PA measurements are required to obtain reliable results. For this, PA of 63 wheelchair-dependent patients with a SCI were measured using wearable sensors. Patients of all age ranges (49.3 ± 16.6 years) and levels of injury (from C1 to L2, ASIA A-D) were included for this study and assessed at three to four different time periods during inpatient rehabilitation (2 weeks, 1 month, 3 months, and if applicable 6 months after injury) and after in-patient rehabilitation in their home-environment (at least 6 months after injury). The metrics of interest were total activity counts, PA intensity levels, metrics of wheeling quantity and metrics of movement quality. Activity counts showed consistently high single-day reliabilities, while measures of PA intensity levels considerably varied depending on the rehabilitation progress. Single-day reliabilities of metrics of movement quantity decreased with rehabilitation progress, while metrics of movement quality increased. To achieve a mean reliability of 0.8, we found that three continuous recording days are required for out-patients, and 2 days for in-patients. Furthermore, the results show similar weekday and weekend wheeling activity for in- and out-patients. To our knowledge, this is the first study to investigate the reliability of an extended set of sensor-based measures of PA in both acute and chronic wheelchair-dependent SCI patients. The results provide recommendations for sensor-based assessments of PA in clinical SCI studies.
Collapse
Affiliation(s)
- Sophie Schneider
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Werner L. Popp
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
- Rehabilitation Engineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Michael Brogioli
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Urs Albisser
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - László Demkó
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Isabelle Debecker
- REHAB Basel, Clinic for Neurorehabilitation and Paraplegiology, Basel, Switzerland
| | | | - Roger Gassert
- Rehabilitation Engineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Armin Curt
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| |
Collapse
|
14
|
Popp WL, Richner L, Brogioli M, Wilms B, Spengler CM, Curt AEP, Starkey ML, Gassert R. Estimation of Energy Expenditure in Wheelchair-Bound Spinal Cord Injured Individuals Using Inertial Measurement Units. Front Neurol 2018; 9:478. [PMID: 30018586 PMCID: PMC6037746 DOI: 10.3389/fneur.2018.00478] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2018] [Accepted: 06/01/2018] [Indexed: 01/29/2023] Open
Abstract
A healthy lifestyle reduces the risk of cardio-vascular disease. As wheelchair-bound individuals with spinal cord injury (SCI) are challenged in their activities, promoting and coaching an active lifestyle is especially relevant. Although there are many commercial activity trackers available for the able-bodied population, including those providing feedback about energy expenditure (EE), activity trackers for the SCI population are largely lacking, or are limited to a small set of activities performed in controlled settings. The aims of the present study were to develop and validate an algorithm based on inertial measurement unit (IMU) data to continuously monitor EE in wheelchair-bound individuals with a SCI, and to establish reference activity values for a healthy lifestyle in this population. For this purpose, EE was measured in 30 subjects each wearing four IMUs during 12 different physical activities, randomly selected from a list of 24 activities of daily living. The proposed algorithm consists of three parts: resting EE estimation based on multi-linear regression, an activity classification using a k-nearest-neighbors algorithm, and EE estimation based on artificial neural networks (ANNs). The mean absolute estimation error for the ANN-based algorithm was 14.4% compared to indirect calorimeter measurements. Based on reference values from the literature and the data collected within this study, we recommend wheeling 3 km per day for a healthy lifestyle in wheelchair-bound SCI individuals. Combining the proposed algorithm with a recommendation for physical activity provides a powerful tool for the promotion of an active lifestyle in the SCI population, thereby reducing the risk for secondary diseases.
Collapse
Affiliation(s)
- Werner L Popp
- Rehabilitation Engineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.,Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Lea Richner
- Rehabilitation Engineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.,Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Michael Brogioli
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Britta Wilms
- Exercise Physiology Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.,Department of Internal Medicine I, University of Lübeck, Lübeck, Germany
| | - Christina M Spengler
- Exercise Physiology Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Armin E P Curt
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland
| | - Michelle L Starkey
- Spinal Cord Injury Center, Balgrist University Hospital, Zurich, Switzerland.,Department of Clinical Neurosciences & MRC Centre for Stem Cell Biology and Regenerative Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Roger Gassert
- Rehabilitation Engineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| |
Collapse
|