Towards co-design of rehabilitation technologies: a collaborative approach to prioritize usability issues

Introduction

Early stakeholder engagement is critical to the successful development and translation of rehabilitation technologies, a pivotal step of which is usability testing with intended end-users. To this end, several methods employ end-user feedback to identify usability and implementation issues. However, the process of prioritizing identified issues seldom leverages the knowledge and expertise of the range of stakeholders who will ultimately affect the demand and supply of a device. This paper describes a novel method to prioritize end-user feedback using transdisciplinary stakeholder consultation and address it in subsequent product development. The proposed approach was demonstrated using a case study relating to the development of a novel technology for neural recovery after spinal cord injury.

Method

Feedback from five individuals with chronic spinal cord injury was collected during two-hour usability evaluation sessions with a fully functional high-fidelity system prototype. A think-aloud and semi-structured interview protocol was used with each participant to identify usability and acceptability issues relating to the system in a 3-phase approach. Phase 1 involved extracting usability issues from think-aloud and semi-structured interview data. Phase 2 involved rating the usability issues based on their significance, technical feasibility, and implementation priority by relevant internal and external stakeholders. Finally, Phase 3 involved aggregating the usability issues according to design and implementation elements to facilitate solution generation, and these solutions were then raised as action tasks for future design iterations.

Results

Sixty usability issues representing nine facets of usability were rated. Eighty percent of issues were rated to be of moderate to high significance, 83% were rated as being feasible to address, and 75% were rated as addressable using existing project resources. Fifty percent of the issues were rated to be a high priority for implementation. Evaluation of the grouped issues identified 21 tasks which were mapped to the product roadmap for integration into future design iterations.

Discussion

This paper presents a method for meaningful transdisciplinary stakeholder engagement in rehabilitation technology development that can extended to other projects. Alongside a worked example, we offer practical considerations for others seeking to co-develop rehabilitation technologies.

Calibration and validation of physical behaviour cut-points using wrist-worn ActiGraphs for children and adolescents: A systematic review

OBJECTIVES

To review cut-points calibrated and independently validated from wrist-worn ActiGraph accelerometers to measure moderate to vigorous physical activity (MVPA) and time spent sedentary (SED) in children and adolescents.

DESIGN

Systematic literature review.

METHODS

Five databases were searched for relevant cut-point calibration and independent validation studies relating to wrist worn ActiGraphs in children and adolescents from inception through 30 April 2022. Extracted data included: country of publication; study name; population; device model; wear location; sampling frequency; epoch length; activity protocol; criterion method and definitions used to classify PA intensity; statistical methods for calibration; statistical methods for validation/cross-validation; and MVPA and SED outcome.

RESULTS

Fourteen calibration studies and seven independent validation studies were identified. Calibrated cut-points for MVPA vector magnitude counts ranged from 7065 to 9204 counts per minute (cpm) and 63.5 to 201 milli-gravitational units (mg). For SED, calibrated cut-points ranged from <2556 cpm to 4350 cpm and 30.8 to 48.1 mg. Classification accuracy values determined by independent validation studies varied, with kappa values ranging from 0.31 to 0.60 and area under the curve statistics ranging from 0.51 to 0.84 for MVPA and kappa values ranging from 0.31 to 0.44 and area under the curve statistics ranging from 0.70 to 0.85 for SED.

CONCLUSIONS

The results of this systematic literature review support the use of the Crouter and colleagues cut-points for the measurement of MVPA and SED for children and adolescents aged 6-12 years. Further work is required to independently validate cut-points developed in younger children and older adolescents.

Defining dignity at the intersection of disability: a scoping review

PURPOSE

This scoping literature review aimed to determine the definition of dignity in relation to disability. It also examined the extent to which inclusive research methods have been used to develop working definitions.

MATERIALS AND METHODS

A comprehensive search was conducted in five electronic databases, using a modified framework by Arksey and O'Malley. Narrative synthesis and qualitative content analysis were employed to examine definitions of dignity and the use of inclusive research methods.

RESULTS

22 peer-reviewed studies were included. The majority of the studies were qualitative (72.72%) and examined various disability populations in diverse settings. Although 19 studies offered a definition of dignity, there was no clear consensus. Dignity was frequently defined from a utilitarian perspective, emphasising affordances and barriers. However, engagement with theoretical constructs was superficial and limited. Further, no studies mentioned the use of inclusive research methods.

CONCLUSIONS

The absence of inclusive research methods hinders the development of a comprehensive definition of dignity that is accepted by and relevant to people with disability. Engaging with both theoretical and empirical perspectives of dignity is crucial to develop a meaningful and inclusive definition, which can inform interventions and policies that enhance dignity for people with disability across diverse settings and contexts.

Towards Translation of Novel Neurorehabilitation Systems: A Practical Approach to Usability Testing

Usability testing is important for the effective translation of neurorehabilitation technologies but is often overlooked and under-reported. The aim of this paper is to present a method of collecting and analyzing usability data, using a think-aloud and semi-structured interview protocol and qualitative analysis techniques. We present a worked case study of this method with a novel neurorehabilitation system that utilizes thought-controlled robotics to partially restore lower-limb function of people with spinal cord injury (SCI). Five male participants (mean age = 32.6 years) with SCI who identified as users of related neurorehabilitation technologies completed the usability study. Video-recorded usability sessions utilized a combination of concurrent and retrospective think-aloud methods as well as semi-structured interviews. Recordings were analyzed to identify verbal and behavioral feedback from participants regarding system performance and acceptability. In total, 538 data points were logged, which were aggregated into 60 usability issues, 44 positive evaluations, and 31 strategies for improvement. The approach undertaken was novel in that we sought to not only capture usability issues but also system elements that were positively evaluated by intended users and strategies for improvement from the perspective of intended users. These observations will be used to inform the further development of the neurorehabilitation system.

End-User Perspectives of the Importance of Rehabilitation Technologies and Related Values for Implementation

Despite the increased availability of rehabilitation technologies (such as robotics) and evidence to support their use, their adoption is still limited in practice. To begin to address this issue, we sought to better understand the perspectives of end-users regarding the implementation of rehabilitation technologies through an online survey. Fifty unique responses across Client (e.g., people with disability and carers), Allied Health (e.g., occupational and physical therapists, podiatrists, psychologists, dieticians, audiologists, exercise physiologists), and Medical (i.e., physicians and nurses) groups were analyzed. Respondents considered rehabilitation technologies to be important (median across groups of 9 out of 10). Across groups, value statements related to the implementation of rehabilitation technologies ranked from most to least important related to: benefits of technology to its intended end-user with disability, practical use of technologies, the technologies themselves (e.g., innovative, established, stand-alone), and their impact on health professionals or the health system as a whole. There were similarities and differences in ranking within and across end-user groups. The prioritization of statements indicates where development efforts can be focused to address end-user goals, and disparity in results across groups supports rich stakeholder engagement during rehabilitation technology development.

Community-based physical activity promotion confers broad-spectrum benefits for military veterans with chronic and complex conditions: evidence from 4 years of rehabilitation consultant referrals

INTRODUCTION

Veterans experience a high incidence of chronic and complex health conditions requiring a holistic approach to health and well-being. The Adapted Physical Activity Program (APAP) is a theory-based programme developed to support the physical activity (PA) participation of community-dwelling people with disabilities. Although available to all people with disabilities, of the 214 clients referred between 2015 and 2019, two hundred and three were veterans. This study aimed to understand this unexpected predominance by describing the characteristics of the veterans referred to APAP, including client goals, as well as describing the characteristics of the rehabilitation consultants who made the referrals.

METHODS

Descriptive statistics were used to describe specific characteristics of the veterans and the rehabilitation consultants. Content analysis was used to analyse client goals.

RESULTS

Client data highlighted the complexity of this clinical population. All clients had been diagnosed with more than one health condition, with most experiencing both a physical injury and a mental health diagnosis. Content analysis revealed six overarching client goals, including supporting sustainable PA participation, mental health and well-being, participation in meaningful activities, community and social engagement, management of condition and physical health and fitness. Data from the referring organisations showed that each organisation had multiple health professionals that made repeated referrals to APAP. The most common health profession to make a referral to APAP was occupational therapy.

CONCLUSION

Veterans have a high incidence of chronic and complex health conditions including physical injury and mental illness. Programmes and services that look beyond addressing the diagnosis and treatment of specific conditions to supporting the overall health and well-being of the individual are required. Person-centred, community-based PA programmes such as APAP might offer this solution. Further research is required to assess the efficacy of such programmes with this population.

Factors that influence the adoption of rehabilitation technologies: a multi-disciplinary qualitative exploration

BACKGROUND

Technological innovation is recognised as having the potential to enhance rehabilitation for people with disability. Yet, resistance to, and abandonment of, rehabilitation technology is prevalent and the successful translation of technology into rehabilitation settings remains limited. Therefore, the aim of this work was to develop an in-depth, multi-stakeholder perspective on what influences the adoption of rehabilitation technologies.

METHODS

Semi-structured focus groups were conducted as part of a larger research project aiming to facilitate the co-design of a novel neurorestorative technology. Focus group data were analysed using a five-phase hybrid deductive-inductive approach to qualitative data analysis.

RESULTS

Focus groups were attended by 43 stakeholders with expertise in one or more of the following fields: people with disability, allied health, human movement science, computer science, design, engineering, ethics, funding, marketing, business, product development, and research development. Six main themes influencing the adoption of technology in rehabilitation were identified: cost beyond the purchase price, benefits to all stakeholders, trust to be earned in technology, ease of technology operation, ability to access technology, and the 'co' in co-design. All six themes were found to be interrelated; in particular, the importance of direct stakeholder engagement in the development of rehabilitation technologies (the 'co' in co-design) was prevalent in all themes.

CONCLUSIONS

A range of complex and interrelated factors influence the adoption of rehabilitation technologies. Importantly, many of the issues that have the potential to negatively impact rehabilitation technology adoption may be addressed during development by utilising the experience and expertise of stakeholders who influence its supply and demand. Our findings state that a wider cohort of stakeholders needs to be actively engaged in the development of rehabilitation technologies to better address the factors that contribute to technology underutilisation and abandonment and facilitate better outcomes for people with disability.

Physical Activity Preferences of People Living with Brain Injury: Formative Qualitative Research to Develop a Discrete Choice Experiment

BACKGROUND AND OBJECTIVE

The World Health Organization physical activity guidelines for people living with disability do not consider the needs of people living with moderate-to-severe traumatic brain injury. This paper describes the qualitative co-development of a discrete choice experiment survey to inform the adaption of these guidelines by identifying the physical activity preferences of people living with moderate-to-severe traumatic brain injury in Australia.

METHODS

The research team comprised researchers, people with lived experience of traumatic brain injury and health professionals with expertise in traumatic brain injury. We followed a four-stage process: (1) identification of key constructs and initial expression of attributes, (2) critique and refinement of attributes, (3) prioritisation of attributes and refinement of levels and (4) testing and refining language, format and comprehensibility. Data collection included deliberative dialogue, focus groups and think-aloud interviews with 22 purposively sampled people living with moderate-to-severe traumatic brain injury. Strategies were used to support inclusive participation. Analysis employed qualitative description and framework methods.

RESULTS

This formative process resulted in discarding, merging, renaming and reconceptualising attributes and levels. Attributes were reduced from an initial list of 17 to six: (1) Type of activity, (2) Out-of-pocket cost, (3) Travel time, (4) Who with, (5) Facilitated by and (6) Accessibility of setting. Confusing terminology and cumbersome features of the survey instrument were also revised. Challenges included purposive recruitment, reducing diverse stakeholder views to a few attributes, finding the right language and navigating the complexity of discrete choice experiment scenarios.

CONCLUSIONS

This formative co-development process significantly improved the relevance and comprehensibility of the discrete choice experiment survey tool. This process may be applicable in other discrete choice experiment studies.

Telehealth interventions for physical activity and exercise participation in postpartum women: A quantitative systematic review

Postpartum women are one of the least physically active vulnerable populations globally and telehealth has been proposed as a potential method of delivering effective exercise interventions for this population. However, clinical practice guidelines are based upon the recommendations for the general population and therefore, the most efficacious exercise dose and the delivery method for this population is unclear. This quantitative systematic review will examine the implementation and outcomes of telehealth exercise interventions in the postpartum population to synthesise the degree to which these outcomes have been assessed and evaluated. Five databases were searched from January 2001 to March 2022. Studies implementing synchronous telehealth exercise interventions for postpartum women were included. Interventions were examined against the Template for Intervention Description and Replication (TIDieR) checklist that assesses intervention reporting completeness and replicability. Of the 1036 records identified, 16 studies progressed to data extraction. Six interventions provided individualised exercise prescription, and only four were delivered by university-level exercise practitioners. Physical activity participation was well reported, however health-related outcomes (i.e., muscular strength and aerobic capacity) were very minimally assessed. Only one intervention utilised modern video conferencing as the primary telehealth communication method. With the minimal assessment of health-related outcomes, there is limited scope to assess the effectiveness of these interventions for postpartum women. Future research interventions need to be reported according to a validated trial reporting system and focus on relevant health related outcomes including postpartum depressive symptoms, quality of life, cardiovascular fitness, muscular strength and body composition.

The effect of physical activity on health outcomes in people with moderate-to-severe traumatic brain injury: a rapid systematic review with meta-analysis

BACKGROUND

In 2020, the World Health Organization (WHO) released the first global physical activity and sedentary behaviour guidelines for children and adults living with disability. The evidence informing the guidelines though is not specific to people living with traumatic brain injury (TBI), but rather comes from other disabling conditions such as Parkinson's disease, and stroke. There remains a clear lack of direct evidence of the effects of physical activity for people living with TBI. The objective of this rapid review was to identify direct evidence of the effect of physical activity on health outcomes in people with moderate-to-severe TBI to inform adaptation of the WHO physical activity guidelines into clinical practice guidelines.

METHODS

We conducted a rapid systematic review with meta-analysis of randomised controlled trials, including people of any age with moderate-to-severe TBI, investigating physical activity interventions compared to either usual care, a physical activity intervention with different parameters, or a non-physical activity intervention. Four databases (CENTRAL, SPORTDiscus, PEDro, Ovid MEDLINE) were searched from inception to October 8, 2021. The primary outcomes were physical function, cognition, and quality of life.

RESULTS

Twenty-three studies were included incorporating 812 participants (36% females, majority working-age adults, time post-TBI in studies ranged from 56 days (median) to 16.6 years (mean)). A range of physical activity interventions were evaluated in rehabilitation (n = 12 studies), community (n = 8) and home (n = 3) settings. We pooled data from the end of the intervention for eight outcomes. Participation in a virtual reality physical activity intervention improved mobility, assessed by the Community Balance and Mobility Scale (range 0 to 96; higher score indicates better mobility) more than standard balance training (two studies, 80 participants, Mean Difference = 2.78, 95% CI 1.40 to 4.16; low certainty evidence). There was uncertainty of effect for the remaining outcomes, limited by small sample sizes, diverse comparators and a wide range of outcome measures.

CONCLUSION

This review consolidates the current evidence base for the prescription of physical activity for people with moderate-to-severe TBI. There remains a pressing need for further rigorous research in order to develop practice guidelines to support clinical decision-making when prescribing physical activity in this population.

Evaluation of a physical activity promotion intervention for adults with whiplash associated disorders: a single-case experimental design study

PURPOSE

There is considerable variation in the physical and psychological presentations of people with whiplash-associated disorder (WAD). Optimal treatment continues to be a challenge. This research evaluated the efficacy of a community-located, theory-based intervention designed to promote physically active behaviour in people with persistent WAD, and thereby improve perceptions of pain interference and confidence completing activities in the presence of neck pain.

MATERIALS AND METHODS

A multiple-baseline, single-case experimental design was used to evaluate the 16-week intervention across six participants.

RESULTS

Weighted Tau-U showed significantly increased accelerometer-measured physical activity in three participants with large effect sizes (>0.5), with increased confidence in one participant (ES > 0.5), and reduced pain interference in another participant (ES > 0.7). Changes in other behaviours included clinically important improvements in quality of life for five participants and, in those participants with baseline symptom levels outside threshold levels, improvements in pain catastrophizing and pain self-efficacy.

CONCLUSIONS

Participation in a theory-based intervention resulted in significant improvements in physical and psychological health for five of six participants. Providing this type of community-located physical activity promotion strategy, to individuals with persistent WAD, may help address physical impairments and psychological distress commonly experienced in WAD. Trial registration: The trial was registered with the Australia and New Zealand Clinical Trials Registry (ACTRN: ACTRN12617001261303p) and ClinicalTrials.gov (Protocol Number: 2018000349/2017/743).Implications for rehabilitationRehabilitation professionals should consider recommending theory-based physical activity promotion strategies to reduce physical impairments and psychological distress in individuals with persistent WAD.Individually tailored physical activity promotion strategies may help individuals with persistent WAD become more physically active thereby reducing their risk of diseases associated with inactivity which may compound the effects of WADImprovements in physical and psychological health may occur independently of increasing habitual physical activity.Rehabilitation professionals may find that other community-located strategies which aim to promote physically active behaviour confer similar benefits for individuals with persistent WAD.