Reducing the number of test items of the Action Research Arm Test post stroke: A decision tree analysis

Accuracy and Reliability of Remote Categorization of Upper Limb Outcome After Stroke

BACKGROUND

There is an increasing need for motor assessments after stroke that can be performed quickly and remotely. The Fast Outcome Categorization of the Upper Limb after Stroke-4 (FOCUS-4) assessment remotely classifies upper limb outcome into 1 of 4 categories after stroke and was developed via retrospective analysis of Action Research Arm Test (ARAT) scores.

OBJECTIVE

The aim of this study was to prospectively evaluate the accuracy and reliability of FOCUS-4 assessments for categorizing upper limb outcome after stroke when administered remotely during a videocall compared to an in-person ARAT.

METHODS

Data were collected from 26 participants at 3 months post-stroke (3M), 27 participants at 6 months post-stroke (6M), and 56 participants at the chronic stage of stroke (>6M). Participants performed an in-person ARAT and a remote FOCUS-4 assessment administered during a videocall, and accuracy was evaluated by comparing the upper limb outcome categories. Participants at the chronic stage of stroke also performed a second remote FOCUS-4 assessment to assess between-day reliability.

RESULTS

Overall accuracy of the remote FOCUS-4 assessment was 88% at 3M and 96% at 6M. Overall accuracy of the first and second remote FOCUS-4 assessments at the chronic stage was 75% and 79%, respectively. Reliability of the FOCUS-4 assessment at the chronic stage was 82%. The remote FOCUS-4 assessment was most accurate and reliable for participants with mild or severe upper limb functional impairment.

CONCLUSIONS

The remote FOCUS-4 assessment has potential to classify upper limb functional capacity or to screen possible participants for stroke trials, but external validation is required.

Psychometric properties of the Action Research Arm Test using decision rules for skipping items in hemiparetic patients after stroke: a retrospective study

PURPOSE

Important properties have been studied using the Action Research Arm Test (ARAT) in patients with stroke. However, whether the ARAT subtests constitute a Guttman scale (i.e., items hierarchically ordered according to difficulty) remains unclear. Guttman scales can define decision rules for skipping items in patients with low endurance. This study investigated the psychometric properties of the ARAT when applying decision rules for post-stroke hemiparetic patients.

METHODS

A retrospective, single-institution study was conducted between 2020 and 2021. Datasets of 30 patients with stroke-induced hemiparesis were collected from a previous study which employed the ARAT without decision rules, Fugl-Meyer assessment (FMA), Box and Block Test (BBT), and Motor Activity Log (MAL). The ARAT was rescored with decision rules for this study, and inter-rater reliability/agreement, parallel forms reliability, and construct validity were assessed.

RESULTS

Parallel forms reliability (Spearman's rho) was 0.99 (95% CI, 0.99-0.99) for both raters. The lower 95% CI limits of the sum and individual item scores in the reliability analysis exceeded the planned value (0.8). Construct validity values exceeded the planned value (0.8) for FMA, BBT, and MAL.

CONCLUSION

Decision rules can be used to skip ARAT items when assessing upper extremity motor function in stroke patients.IMPLICATIONS FOR REHABILITATIONThe Action Research Arm Test with decision rules for skipping items was valid and reliable for measuring upper extremity motor function in hemiparetic patients after stroke.The decision rules may reduce the burden of both patients and evaluators by decreasing the number of Action Research Arm Test items to be administrated.

Performing a shortened version of the Action Research Arm Test in immersive virtual reality to assess post-stroke upper limb activity

BACKGROUND

To plan treatment and measure post-stroke recovery, frequent and time-bounded functional assessments are recommended. With increasing needs for neurorehabilitation advances, new technology based methods, such as virtual reality (VR) have emerged. Here, we developed an immersive VR version of the Action Research Arm Test (ARAT-VR) to complement neurorehabilitation.

OBJECTIVE

This study aimed to assess the validity, usability and test-retest reliability of the ARAT-VR among individuals with stroke, healthcare professionals and healthy control subjects (HCS).

METHODS

Among the 19 items of the ARAT, 13 items were selected and developed in immersive VR. 11 healthcare professionals, 30 individuals with stroke, and 25 HCS were recruited. Content validity was assessed by asking healthcare professionals to rate the difficulty of performing each item of the ARAT-VR in comparison to the classical Action Research Arm Test (ARAT-19). Concurrent validity was first measured using correlation (Spearman tests) between the ARAT-VR and ARAT-19 scores for the individuals with stroke, and second through correlation and comparison between the scores of the ARAT-VR and the reduced version of the ARAT (ARAT-13) for both individuals with stroke and HCS (Wilcoxon signed rank tests and Bland-Altman plots). Usability was measured using the System Usability Scale. A part of individuals with stroke and HCS were re-tested following a convenient delay to measure test-retest reliability (Intra-class correlation and Wilcoxon tests).

RESULTS

Regarding the content validity, median difficulty of the 13 ARAT-VR items (0[0 to - 1] to 0[0-1]) evaluated by healthcare professionals was rated as equivalent to the classical ARAT for all tasks except those involving the marbles. For these, the difficulty was rated as superior to the real tasks (1[0-1] when pinching with the thumb-index and thumb-middle fingers, and 1[0-2] when pinching with thumb-ring finger). Regarding the concurrent validity, for paretic hand scores, there were strong correlations between the ARAT-VR and ARAT-13 (r = 0.84), and between the ARAT-VR and ARAT-19 (r = 0.83). Usability (SUS = 82.5[75-90]) and test-retest reliability (ICC = 0.99; p < 0.001) were excellent.

CONCLUSION

The ARAT-VR is a valid, usable and reliable tool that can be used to assess upper limb activity among individuals with stroke, providing potential to increase assessment frequency, remote evaluation, and improve neurorehabilitation. Trial registration https://clinicaltrials.gov/ct2/show/NCT04694833 ; Unique identifier: NCT04694833, Date of registration: 11/24/2020.