Description and interobserver reliability of the Tufts Assessment of Motor Performance

Development of a wheelchair mobility skills test for children and adolescents: combining evidence with clinical expertise

Background

Wheelchair mobility skills (WMS) training is regarded by children using a manual wheelchair and their parents as an important factor to improve participation and daily physical activity. Currently, there is no outcome measure available for the evaluation of WMS in children. Several wheelchair mobility outcome measures have been developed for adults, but none of these have been validated in children. Therefore the objective of this study is to develop a WMS outcome measure for children using the current knowledge from literature in combination with the clinical expertise of health care professionals, children and their parents.

Methods

Mixed methods approach. Phase 1: Item identification of WMS items through a systematic review using the ‘COnsensus-based Standards for the selection of health Measurement Instruments’ (COSMIN) recommendations. Phase 2: Item selection and validation of relevant WMS items for children, using a focus group and interviews with children using a manual wheelchair, their parents and health care professionals. Phase 3: Feasibility of the newly developed Utrecht Pediatric Wheelchair Mobility Skills Test (UP-WMST) through pilot testing.

Results

Phase 1: Data analysis and synthesis of nine WMS related outcome measures showed there is no widely used outcome measure with levels of evidence across all measurement properties. However, four outcome measures showed some levels of evidence on reliability and validity for adults. Twenty-two WMS items with the best clinimetric properties were selected for further analysis in phase 2. Phase 2: Fifteen items were deemed as relevant for children, one item needed adaptation and six items were considered not relevant for assessing WMS in children. Phase 3: Two health care professionals administered the UP-WMST in eight children. The instructions of the UP-WMST were clear, but the scoring method of the height difference items needed adaptation. The outdoor items for rolling over soft surface and the side slope item were excluded in the final version of the UP-WMST due to logistic reasons.

Conclusions

The newly developed 15 item UP-WMST is a validated outcome measure which is easy to administer in children using a manual wheelchair. More research regarding reliability, construct validity and responsiveness is warranted before the UP-WMST can be used in practice.

Electronic supplementary material

The online version of this article (doi:10.1186/s12887-017-0809-9) contains supplementary material, which is available to authorized users.

Review of Three Tests of Motor Proficiency in Children

The present purpose is to provide clinicians, occupational and physical therapists, and educators with a comparative analysis of three tests of motor proficiency. The Bruininks-Oseretsky Test of Motor Proficiency, Movement Assessment Battery for Children, and Tufts Assessment of Motor Performance were developed to assess the motor skills of children with developmental delays. The selection criteria, interrater reliability, reproducibility, and recommended use of each test are reported here. Recommendations for use of each test include standardization of the sample population to ensure its appropriateness.

A Hierarchical Model of Functional Performance in Rehabilitation Medicine

This article describes the development of the Tufts Assessment of Motor Performance (TAMP). The TAMP measures fine and gross motor performance status across multiple classifications of functional skills. A Raschmodel item response theory analysis supported the hypothesis that the eight motor domains within the TAMP have a hierarchical structure consistent with clinical expectation. Furthermore, total scores summed across the domains were clinically meaningful and statistically defensible. An example of how the TAMP may be employed in clinical assessment is provided. Advantages of the use of the Rasch model are discussed in reference to issues of instrument construction and the clinical description of motor performance.

A review of five tests to identify motor coordination difficulties in young adults

Difficulties with low motor competence in childhood and adolescence, such as that seen in Developmental Coordination Disorder (DCD), often persist into adulthood. Identification of DCD at all ages is particularly challenging and problematic because of the diversity of motor symptoms. Many tests of motor proficiency and impairment have been developed for children up to 12 years of age. Whilst identification of DCD is important during childhood, it is of equal importance to identify and monitor the impact of this impairment as an individual grows and develops. Currently there is no test specifically designed to support diagnosis and monitor change in the age range 16-30 years. In this article we review five tests that have been used to assess motor competence among young adults (Bruininks-Oseretsky Test of Motor Proficiency-2, McCarron Assessment of Neuromuscular Development, Movement Assessment Battery for Children-2, Tufts Assessment of Motor Performance and the Zurich Neuromotor Assessment). Key issues relevant to testing motor skills in older populations, such as the inclusion of age appropriate skills, are explored. While the BOT-2 provided the most evidence for valid and reliable measurement of Criterion A of the diagnostic criteria for DCD among this age group, no test adequately evaluated Criterion B. Further evaluation of motor skill assessment among the young adult population is needed.

A systematic review of instruments for assessment of capacity in activities of daily living in children with developmental co-ordination disorder

Children with developmental co-ordination disorder (DCD) face evident motor difficulties in activities of daily living (ADL). Assessment of their capacity in ADL is essential for diagnosis and intervention, in order to limit the daily consequences of the disorder. The aim of this study is to systematically review potential instruments for standardized and objective assessment of children's capacity in ADL, suited for children with DCD. As a first step, databases of MEDLINE, EMBASE, CINAHL and PsycINFO were searched to identify studies that described instruments with potential for assessment of capacity in ADL. Second, instruments were included for review when two independent reviewers agreed that the instruments (1) are standardized and objective; (2) assess at activity level and comprise items that reflect ADL; and (3) are applicable to school-aged children that can move independently. Out of 1507 publications, 66 publications were selected, describing 39 instruments. Seven of these instruments were found to fulfil the criteria and were included for review: the Bruininks-Oseretsky Test of Motor Performance-2 (BOT2); the Do-Eat (Do-Eat); the Movement Assessment Battery for Children-2 (MABC2); the school-Assessment of Motor and Process Skills (schoolAMPS); the Tuffts Assessment of Motor Performance (TAMP); the Test of Gross Motor Development (TGMD); and the Functional Independence Measure for Children (WeeFIM). As a third step, for the included instruments, suitability for children with DCD was discussed based on the ADL comprised, ecological validity and other psychometric properties. We concluded that current instruments do not provide comprehensive and ecologically valid assessment of capacity in ADL as required for children with DCD.

On the construction of a skill-based wheelchair navigation profile

Assisted wheelchair navigation is of key importance for persons with severe disabilities. The problem has been solved in different ways, usually based on the shared control paradigm. This paradigm consists of giving the user more or less control on a need basis. Naturally, these approaches require personalization: each wheelchair user has different skills and needs and it is hard to know a priori from diagnosis how much assistance must be provided. Furthermore, since there is no such thing as an average user, sometimes it is difficult to quantify the benefits of these systems. This paper proposes a new method to extract a prototype user profile using real traces based on more than 70 volunteers presenting different physical and cognitive skills. These traces are clustered to determine the average behavior that can be expected from a wheelchair user in order to cope with significant situations. Processed traces provide a prototype user model for comparison purposes, plus a simple method to obtain without supervision a skill-based navigation profile for any user while he/she is driving. This profile is useful for benchmarking but also to determine the situations in which a given user might require more assistance after evaluating how well he/she compares to the benchmark. Profile-based shared control has been successfully tested by 18 volunteers affected by left or right brain stroke at Fondazione Santa Lucia, in Rome, Italy.

A systematic review of wheelchair skills tests for manual wheelchair users with a spinal cord injury: towards a standardized outcome measure

OBJECTIVE

To review, analyse, evaluate and critically appraise available wheelchair skill tests in the international literature and to determine the need for a standardized measurement tool of manual wheeled mobility in those with spinal cord injury.

DATA SOURCES

A systematic review of literature (databases PubMed, Web of Science and Cochrane Library (1970-December 2009).

SUBJECTS

Hand rim wheelchair users, mainly those with spinal cord injury.

REVIEW METHODS

Studies' content and methodology were analysed qualitatively. Study quality was assessed using the scale of Gardner and Altman.

RESULTS

Thirteen studies fell within the inclusion criteria and were critically reviewed. The 13 studies covered 11 tests, which involved 14 different skills. These 14 skills were categorized into: wheelchair manoeuvring and basic daily living skills; obstacle-negotiating skills; wheelie tasks; and transfers. The Wheelchair Skills Test version 2.4 (WST-2.4) and Wheelchair Circuit tests scored best on the Gardner and Altman scale, the Obstacle Course Assessment of Wheelchair User Performances (OCAWUP) test was found to be the most relevant for daily needs in a wheelchair. The different tests used different measurement scales, varying from binary to ordinal and continuous. Comparison of outcomes between tests was not possible because of differences in skills assessed, measurement scales, environment and equipment selected for each test. A lack of information regarding protocols as well as differences in terminology was also detected.

CONCLUSION

This systematic review revealed large inconsistencies among the current available wheelchair skill tests. This makes it difficult to compare study results and to create norms and standards for wheelchair skill performance.

Assessment of functional capacity of the musculoskeletal system in the context of work, daily living, and sport: a systematic review

The aim of this systematic review was to survey methods to assess the functional capacity of the musculoskeletal system within the context of work, daily activities, and sport. The following key words and synonyms were used: functional physical assessment, healthy/disabled subjects, and instruments. After applying the inclusion criteria on 697 potential studies and a methodological quality appraisal, 34 studies were included. A level of reliability > 0.80 and of > 0.60 resp 0.75 and 0.90, dependent of type of validity, was considered high. Four questionnaires (the Oswestry Disability Index, the Pain Disability Index, the Roland-Morris Disability Questionnaire, and the Upper Extremity Functional Scale) have high levels on both validity and reliability. None of the functional tests had a high level of both reliability and validity. A combination of a questionnaire and a functional test would seem to be the best instrument to assess functional capacity of the musculoskeletal system, but need further examined.

Wheelchair skills tests: a systematic review

OBJECTIVE

To describe and compare the content, feasibility, outcome parameters, and clinimetric properties of the manual wheelchair skills tests reported in the literature.

DESIGN

A systematic literature search was conducted in MEDLINE, EMBASE, PsychINFO and Current Contents. Tests were selected if they were observational tests, designed for subjects using hand-rim wheelchairs and were intended to assess wheelchair skill performance at the activity level.

RESULTS

The search resulted in 34 papers, in which 24 different wheelchair skills tests were described. The skill most frequently included was wheelchair propulsion, consecutively followed by transferring, negotiating kerbs, ascending slopes, traversing tracks, sprinting and performing a wheelie. The three most frequently used outcome parameters were task performance time, independency of task performance, and physical strain during skill performance. Sensitivity to change was evaluated in three tests, validity in 10 tests, and reliability in nine tests.

CONCLUSIONS

Many tests are applied to measure wheelchair skill performance using different tasks and outcome measures. This makes it difficult to compare study results. Consensus among researchers as to which skills must be included as well as to standardization of the use of measurement instruments will reduce this problem and will additionally lead to a better insight in the quality of tests.

The acceleration-velocity relationship: identification of normal and spastic upper extremity movement

This study defines and evaluates a non-invasive technique that will identify a spasm as an uncommanded movement (U) from a normally commanded movement (C). Upper arm function during a tracking task is recognized as non-linear and characterized by a phase plane with acceleration (second derivative of stick position) plotted on the ordinate and velocity (first derivative of stick position) plotted on the abscissa. An acceleration time constant (tau A) is defined as (VA/AM) where AM is the maximal acceleration and VA is the velocity at AM. A deceleration time constant (tau D) is also defined as (VD/DM), where DM is the maximal deceleration and VD is the velocity at DM. Ten spastic subjects (S) were categorized into three groups of mildly spastic (M), intermediately spastic (I), and highly spastic (H) which were compared to five normal subjects (N). The results indicate that for C and U, both VA and AM are significantly lower for S at all three levels as compared to N. tau A is significantly higher for M and I as compared to N. Both VD and tau D are significantly higher for S at all three levels when compared to N. DM is significantly lower for S at all three levels of S when compared to N. Finally, AM and tau A significantly differentiate C vs U for M. VA and tau D significantly differentiate for I. VA, AM as well as DM, tau D significantly differentiate for H. The physical significance of these results is discussed with respect to the time course and magnitude of net muscle moment (M), and the reversal of the agonist-antagonist relationship during the acceleration and deceleration phases. Finally, a spasm identification algorithm is proposed.

Functional outcome measures to assess interventions for spasticity

PURPOSE

Clinicians use functional loss as a criterion to treat spasticity, but the connection between function and severity of spasticity is not well established for monitoring spasticity treatment effect. Studies were reviewed which have implemented outcome measures to assess functional changes relative to changes in spasticity. Criteria for review included the reliability and internal validity of the functional measures used and the strengths/weaknesses of the study designs that likely affected the external validity of the measures for this application. Guidelines are provided for the use and development of functional outcome measures in futures studies of spasticity treatment based on this review.

DATA IDENTIFICATION

An English-language literature search using MEDLINE and bibliographies of published articles and textbooks was conducted.

RESULTS

Very few functional measures demonstrated changes concurrent to a reduction in spasticity. There were multiple potential confounding factors in study protocols, reporting of results, and data analysis that might account for the limited number of measures shown to be valid for this application. Selected standardized ordinal functional outcome scales (the PECS and PEDI) and specific functional tasks were identified as measures that show promise for assessing changes concurrent with altered spasticity level.

CONCLUSION

Based on a review of previous studies, functional measures involving posture, positioning, balance, and certain mobility skills have potential, with further test development, to provide needed information regarding the impact of spasticity on functional outcome.