Evaluation of upper extremity neurorehabilitation using technology: a European Delphi consensus study within the EU COST Action Network on Robotics for Neurorehabilitation

Remotely Assessing Motor Function and Activity of the Upper Extremity After Stroke: A Systematic Review of Validity and Clinical Utility of Tele-Assessments

OBJECTIVE

The aim of this systematic review is to identify currently available tele-assessments for motor impairments of the upper extremity in adults after a stroke and to assess their psychometric properties and clinical utility.

DATA SOURCES

We searched for studies describing the psychometric properties of tele-assessments for the motor function of the upper extremity. A systematic search was conducted in the Cumulative Index to Nursing and Allied Health Literature, Medline via OVID, Embase, The Cochrane Library, Scopus, Web of Science and Institute of Electrical and Electronics Engineers Xplore from inception until 30 April 2024.

REVIEW METHODS

The quality assessment for the included studies and the rating of the psychometric properties were performed using the COSMIN Risk of Bias Checklist for systematic reviews of patient-reported outcome measures.

RESULTS

A total of 12 studies (N = 3912) describing 11 tele-assessments met the predefined inclusion criteria. The included assessments were heterogeneous in terms of quality and psychometric properties and risk of bias. None of the tele-assessments currently meets the criteria of clinical utility to be recommended for clinical practice without restriction.

CONCLUSION

The quality and clinical utility of tele-assessments varied widely, suggesting a cautious consideration for immediate clinical practice application. There is potential for tele-assessments in clinical practice, but the clinical benefits need to be improved by simplifying the complexity of tele-assessments.

REGISTRATION NUMBER

CRD42022335035.

A data set for the design and implementation of the upper limb disability registry

BACKGROUND

If the data elements needed for patient registries are not identified, designing and implementing them can be very challenging. Identifying and introducing a Data Set (DS) can help solve this challenge. The aim of this study was to identify and present a DS for the design and implementation of the upper limb disability registry.

MATERIALS AND METHODS

This cross-sectional study was conducted in two phases. In the first phase, to identify the administrative and clinical data elements required for registry, a comprehensive study was conducted in PubMed, Web of Science, and Scopus databases. Then, the necessary data elements were extracted from the studies and a questionnaire was designed based on them. In the second phase, in order to confirm the DS, the questionnaire was distributed to 20 orthopedic, physical medicine and rehabilitation physicians and physiotherapists during a two-round Delphi. In order to analyze the data, the frequency and mean score of each data element were calculated. Data elements that received an agreement more than 75% in the first or two-round Delphi were considered for the final DS.

RESULTS

A total of 81 data elements in five categories of "demographic data", "clinical presentation", "past medical history", "psychological issues", and "pharmacological and non-pharmacological treatments" were extracted from the studies. Finally, 78 data elements were approved by experts as essential data elements for designing a patient registry for upper limb disabilities.

CONCLUSION

In this study, the data elements necessary for the design and implementation of the upper limb disability registry were suggested. This DS can help registry designers and health data administrators know what data needs to be included in the registry system in order to have a successful design and implementation. Moreover, this standardized DS can be effective for integrating and improving the information management of people with upper limb disabilities and used to accurately gather the upper limb disabilities data for research and policymaking purposes.

Clinical interpretation and cutoff scores for manual ability measured by the ABILHAND questionnaire in people with stroke

BACKGROUND

The ABILHAND questionnaire is recommended to assess perceived manual ability after stroke; however, more knowledge on interpretability is needed to improve the clinical applicability.

OBJECTIVES

To determine clinically meaningful cutoff scores for different levels of perceived manual ability, assessed by ABILHAND, corresponding to established observed and perceived upper extremity assessments post stroke.

METHODS

This cross-sectional study, part of the Stroke Arm Longitudinal Study (SALGOT) at the University of Gothenburg, included 80 participants with upper extremity impairments after stroke. The self-reported upper extremity functioning was assessed with ABILHAND and Stroke Impact Scale Hand (SIS Hand), and the observed functioning was assessed by Fugl-Meyer Assessment for Upper Extremity (FMA-UE) and Action Research Arm Test (ARAT) at 3 months after stroke. Receiver operating characteristic curve, sensitivity, and specificity analyses were used to determine the cutoffs.

RESULTS

The overall discriminating accuracy was excellent (AUC > 0.90) for most of the cutoffs and sensitivity and specificity values ranged from 0.73 to 1.0. The ABILHAND cutoff score 1.78 discriminated well between low and good functioning resulting in a 95% match with SIS Hand and 87.5% match with ARAT and FMA-UE.

CONCLUSIONS

The determined cutoff scores of the ABILHAND, validated through established upper extremity assessments, will provide a useful tool to clinicians when interpreting the logit scores and when selecting individualized treatment options. ABILHAND matched well with self-reported SIS Hand, but discrepancies found with observed scales implies that self-perceived assessments should be complemented with observed assessments.

A unified scheme for the benchmarking of upper limb functions in neurological disorders

BACKGROUND

In neurorehabilitation, we are witnessing a growing awareness of the importance of standardized quantitative assessment of limb functions. Detailed assessments of the sensorimotor deficits following neurological disorders are crucial. So far, this assessment has relied mainly on clinical scales, which showed several drawbacks. Different technologies could provide more objective and repeatable measurements. However, the current literature lacks practical guidelines for this purpose. Nowadays, the integration of available metrics, protocols, and algorithms into one harmonized benchmarking ecosystem for clinical and research practice is necessary.

METHODS

This work presents a benchmarking framework for upper limb capacity. The scheme resulted from a multidisciplinary and iterative discussion among several partners with previous experience in benchmarking methodology, robotics, and clinical neurorehabilitation. We merged previous knowledge in benchmarking methodologies for human locomotion and direct clinical and engineering experience in upper limb rehabilitation. The scheme was designed to enable an instrumented evaluation of arm capacity and to assess the effectiveness of rehabilitative interventions with high reproducibility and resolution. It includes four elements: (1) a taxonomy for motor skills and abilities, (2) a list of performance indicators, (3) a list of required sensor modalities, and (4) a set of reproducible experimental protocols.

RESULTS

We proposed six motor primitives as building blocks of most upper-limb daily-life activities and combined them into a set of functional motor skills. We identified the main aspects to be considered during clinical evaluation, and grouped them into ten motor abilities categories. For each ability, we proposed a set of performance indicators to quantify the proposed ability on a quantitative and high-resolution scale. Finally, we defined the procedures to be followed to perform the benchmarking assessment in a reproducible and reliable way, including the definition of the kinematic models and the target muscles.

CONCLUSIONS

This work represents the first unified scheme for the benchmarking of upper limb capacity. To reach a consensus, this scheme should be validated with real experiments across clinical conditions and motor skills. This validation phase is expected to create a shared database of human performance, necessary to have realistic comparisons of treatments and drive the development of new personalized technologies.

European evidence-based recommendations for clinical assessment of upper limb in neurorehabilitation (CAULIN): data synthesis from systematic reviews, clinical practice guidelines and expert consensus

BACKGROUND

Technology-supported rehabilitation can help alleviate the increasing need for cost-effective rehabilitation of neurological conditions, but use in clinical practice remains limited. Agreement on a core set of reliable, valid and accessible outcome measures to assess rehabilitation outcomes is needed to generate strong evidence about effectiveness of rehabilitation approaches, including technologies. This paper collates and synthesizes a core set from multiple sources; combining existing evidence, clinical practice guidelines and expert consensus into European recommendations for Clinical Assessment of Upper Limb In Neurorehabilitation (CAULIN).

METHODS

Data from systematic reviews, clinical practice guidelines and expert consensus (Delphi methodology) were systematically extracted and synthesized using strength of evidence rating criteria, in addition to recommendations on assessment procedures. Three sets were defined: a core set: strong evidence for validity, reliability, responsiveness and clinical utility AND recommended by at least two sources; an extended set: strong evidence OR recommended by at least two sources and a supplementary set: some evidence OR recommended by at least one of the sources.

RESULTS

In total, 12 measures (with primary focus on stroke) were included, encompassing body function and activity level of the International Classification of Functioning and Health. The core set recommended for clinical practice and research: Fugl-Meyer Assessment of Upper Extremity (FMA-UE) and Action Research Arm Test (ARAT); the extended set recommended for clinical practice and/or clinical research: kinematic measures, Box and Block Test (BBT), Chedoke Arm Hand Activity Inventory (CAHAI), Wolf Motor Function Test (WMFT), Nine Hole Peg Test (NHPT) and ABILHAND; the supplementary set recommended for research or specific occasions: Motricity Index (MI); Chedoke-McMaster Stroke Assessment (CMSA), Stroke Rehabilitation Assessment Movement (STREAM), Frenchay Arm Test (FAT), Motor Assessment Scale (MAS) and body-worn movement sensors. Assessments should be conducted at pre-defined regular intervals by trained personnel. Global measures should be applied within 24 h of hospital admission and upper limb specific measures within 1 week.

CONCLUSIONS

The CAULIN recommendations for outcome measures and assessment procedures provide a clear, simple, evidence-based three-level structure for upper limb assessment in neurological rehabilitation. Widespread adoption and sustained use will improve quality of clinical practice and facilitate meta-analysis, critical for the advancement of technology-supported neurorehabilitation.

Arm impairment and walking speed explain real-life activity of the affected arm and leg after stroke

OBJECTIVE

To determine to what extent accelerometer-based arm, leg and trunk activity is associated with sensorimotor impairments, walking capacity and other factors in subacute stroke.

DESIGN

Cross-sectional study.

PATIENTS

Twenty-six individuals with stroke (mean age 55.4 years, severe to mild motor impairment).

METHODS

Data on daytime activity were collected over a period of 4 days from accelerometers placed on the wrists, ankles and trunk. A forward stepwise linear regression was used to determine associations between free-living activity, clinical and demographic variables.

RESULTS

Arm motor impairment (Fugl-Meyer Assessment) and walking speed explained more than 60% of the variance in daytime activity of the more-affected arm, while walking speed alone explained 60% of the more-affected leg activity. Activity of the less-affected arm and leg was associated with arm motor impairment (R2 = 0.40) and independence in walking (R2 = 0.59). Arm activity ratio was associated with arm impairment (R2 = 0.63) and leg activity ratio with leg impairment (R2 = 0.38) and walking speed (R2 = 0.27). Walking-related variables explained approximately 30% of the variance in trunk activity.

CONCLUSION

Accelerometer-based free-living activity is dependent on motor impairment and walking capacity. The most relevant activity data were obtained from more-affected limbs. Motor impairment and walking speed can provide some information about real-life daytime activity levels.

Novel adaptive impedance control for exoskeleton robot for rehabilitation using a nonlinear time-delay disturbance observer

A new adaptive impedance, augmented with backstepping control, time-delay estimation, and a disturbance observer, was designed to perform passive-assistive rehabilitation motion. This was done using a rehabilitation robot whereby humans' musculoskeletal conditions were considered. This control scheme aimed to mimic the movement behavior of the user and to provide an accurate compensation for uncertainties and torque disturbances. Such disturbances were excited by constraints of input saturation of the robot's actuators, friction forces and backlash, several payloads of the attached upper-limb of each patient, and time delay errors. The designed impedance control algorithm would transfer the stiffness of the human upper limb to the developed impedance model via the measured user force. In the proposed control scheme, active rejection of disturbances would be achieved through the direct connection between such disturbances from the observer's output and the control input via the feedforward loop of the system. Furthermore, the computed control input does not require any precise knowledge of the robot's dynamic model or any knowledge of built-in torque-sensing units to provide the desirable physiotherapy treatment. Experimental investigations performed by two subjects were exhibited to support the benefits of the designed approach.

A Systematic Review of International Clinical Guidelines for Rehabilitation of People With Neurological Conditions: What Recommendations Are Made for Upper Limb Assessment?

Background: Upper limb impairment is a common problem for people with neurological disabilities, affecting activity, performance, quality of life, and independence. Accurate, timely assessments are required for effective rehabilitation, and development of novel interventions. International consensus on upper limb assessment is needed to make research findings more meaningful, provide a benchmark for quality in clinical practice, more cost-effective neurorehabilitation and improved outcomes for neurological patients undergoing rehabilitation.

Aim: To conduct a systematic review, as part of the output of a European COST Action, to identify what recommendations are made for upper limb assessment.

Methods: We systematically reviewed published guidance on measures and protocols for assessment of upper limb function in neurological rehabilitation via electronic databases from January 2007–December 2017. Additional records were then identified through other sources. Records were selected for inclusion based on scanning of titles, abstracts and full text by two authors working independently, and a third author if there was disagreement. Records were included if they referred to “rehabilitation” and “assessment” or “measurement”. Reasons for exclusion were documented.

Results: From the initial 552 records identified (after duplicates were removed), 34 satisfied our criteria for inclusion, and only six recommended specific outcome measures and /or protocols. Records were divided into National Guidelines and other practice guidelines published in peer reviewed Journals. There was agreement that assessment is critical, should be conducted early and at regular intervals and that there is a need for standardized measures. Assessments should be conducted by a healthcare professional trained in using the measure and should encompass body function and structure, activity and participation.

Conclusions: We present a comprehensive, critical, and original summary of current recommendations. Defining a core set of measures and agreed protocols requires international consensus between experts representing the diverse and multi-disciplinary field of neurorehabilitation including clinical researchers and practitioners, rehabilitation technology researchers, and commercial developers. Current lack of guidance may hold-back progress in understanding function and recovery. Together with a Delphi consensus study and an overview of systematic reviews of outcome measures it will contribute to the development of international guidelines for upper limb assessment in neurological conditions.

Strong relations of elbow excursion and grip strength with post-stroke arm function and activities: Should we aim for this in technology-supported training?

Objective

To investigate the relationships between an extensive set of objective movement execution kinematics of the upper extremity and clinical outcome measures in chronic stroke patients: at baseline and after technology-supported training at home.

Methods

Twenty mildly to severely affected chronic stroke patients participated in the baseline evaluation, 15 were re-evaluated after six weeks of intensive technology-supported or conventional arm/hand training at home. Grip strength, 3D motion analysis of a reach and grasp task, and clinical scales (Fugl-Meyer assessment (FM), Action Research Arm Test (ARAT) and Motor Activity Log (MAL)) were assessed pre- and post-training.

Results

Most movement execution parameters showed moderate-to-strong relationships with FM and ARAT, and to a smaller degree with MAL. Elbow excursion explained the largest amount of variance in FM and ARAT, together with grip strength. The only strong association after training was found between changes in ARAT and improvements in hand opening (conventional) or grip strength (technology-supported).

Conclusions

Elbow excursion and grip strength showed strongest association with post-stroke arm function and activities. Improved functional ability after training at home was associated with increased hand function. Addressing both reaching and hand function are indicated as valuable targets for (technological) treatment applications to stimulate functional improvements after stroke.

Reduction of Assessment Time for Stroke-Related Impairments Using Robotic Evaluation

Robotic technologies can provide objective, reliable tools for assessing a broad range of sensory, motor and cognitive functions. However, as additional tasks are developed on these platforms, the time necessary to assess a patient increases. In this paper, we present a hierarchical task selection strategy for five tasks that form part of the battery of standard tests performed on the KINARM robotic system. The strategy is built using dependencies derived through three types of analyses: 1) non-linear hierarchical ordering theory is applied to determine the ordering of five tasks; 2) the parameters of all tasks are also ranked using non-linear hierarchical ordering theory; and 3) a modeling technique, fast orthogonal search, is applied to assess the predictive power of each robotic task for the estimation of other task parameters. The inferred hierarchical task selection strategy can lead to a reduction of up to 91% of the time required to assess a patient.