Development of a patient reported outcome measures for measuring the impact of visual impairment following stroke

Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review

PURPOSE

Qualitative data that reflects patients' experiences are the foundation of any patient-reported outcome measure (PROM) development and validation study; however, there is limited understanding of the type of data visualization techniques that facilitate communication of this data. The goal of this targeted literature review was to investigate data visualization methods that have been used in published PROM development and validation literature to report qualitative results.

METHODS

A literature search in OVID via MEDLINE was conducted among the top 10 non-disease-specific journals publishing PROM qualitative development and validation studies. Studies that reported qualitative methods to develop/validate a PROM and included data visualization in the form of tables or figures were included. Article characteristics and data visualization types were extracted.

RESULTS

A total of 185 articles were included in data extraction. Most articles (n = 109, 59.1%) included figures (n = 172, average 2 relevant figures per article) in the form of hierarchy/flowcharts (n = 124, 72.1%) and bar charts (n = 29, 16.9%). Information reported in figures included depiction of conceptual frameworks (n = 112, 65.1%) and concept frequency (n = 40, 24.4%). Most articles (n = 152, 81.7%) included tables (n = 307, average 2 relevant tables per article). Information reported in tables included concept frequency (n = 133, 43.3%) and cognitive debriefing and revisions (n = 91, 29.6%).

CONCLUSION

Data visualization techniques used to report qualitative results in the identified PROM qualitative development and validation studies were heterogeneous, and many studies did not utilize any data visualization techniques. This study will inform the development of guidance for using data visualizations to report qualitative PROM research.

The Screening Visual Complaints questionnaire-acquired brain injury: Development and evaluation of psychometric properties in a community sample

PURPOSE

Visual complaints are a common consequence of acquired brain injury (ABI). Yet, they may be overlooked in clinical practice. The present study aims to develop a screening instrument for assessing visual complaints in individuals with ABI and evaluate its psychometrics properties in a community sample.

METHODS

We constructed the Dutch Screening Visual Complaints questionnaire-acquired brain injury (SVCq-abi), a self-report 23-item questionnaire. A Dutch community sample of 1159 participants (Mean [SD] age, 60 [16] years) completed the SVCq-abi and other questionnaires on visual disturbances, executive functioning, mental health, and autistic traits. Confirmatory factor analyses were performed for 5 models (1-factor, 3-factor, 5-factor, second-order, and bifactor) on a random split of half of the sample, and cross-validated on the other half. In addition, we evaluated floor and ceiling effects, scale reliability, test-retest reliability, as well as convergent and divergent validity.

RESULTS

A 5-factor structure of the SVCq-abi was adopted which showed an excellent model of fit, with all item loadings exceeding 0.5. The SVCq-abi subscales demonstrated various floor effects, acceptable scale reliability, moderate to good test-retest reliability (ICC = 0.65 to 0.73), along with sufficient convergent (r2 = 9% to 32%) and divergent validity (r2 = 2% to 13%).

CONCLUSIONS

The SVCq-abi shows fundamental psychometric properties and the factor analysis provides support for a 5-factor structure. Further validation of the SVCq-abi in individuals with ABI is essential.

A scoping review of patient and public involvement in empirical stroke research

BACKGROUND

Impactful, evidence-based solutions in surveillance, prevention, acute care, and rehabilitation for stroke survivors are required to address the high global burden of stroke. Patient and public involvement (PPI), where patients, their families, and the public are actively involved as research partners, enhances the relevance, credibility, and impact of stroke-related research.

AIMS

This scoping review, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Scoping Review guidelines, aims to identify and summarize how PPI is currently implemented and reported in empirical stroke research using a participatory approach.

SUMMARY OF REVIEW

A comprehensive search strategy was developed and implemented across Medline, CINAHL, EMBASE, PsynchINFO, and Cochrane electronic databases, supplemented by gray literature searches. Empirical stroke research articles in the English language, published from 2014 up to 2023, and documenting PPI activity were included. Of the 18,143 original articles identified, 2824 full-text manuscripts matching from this time window were screened. Only 2% (n = 72) of these directly reported embedded PPI activity in empirical research. The majority were qualitative in design (60%) and conducted in high-income countries (96%). Only one included study originated from a developing country, where the burden of stroke is highest. Most studies (94%) provided some information about the activities carried out with their PPI partners, mainly centered on the study design (57%) and management (64%), with only 4% of studies integrating PPI across all research cycle phases from funding application to dissemination. When studies were examined for compliance with the Guidance for Reporting Involvement of Patients and the Public (GRIPP) short-form checklist, only 11% of included studies were 100% compliant. Twenty-one studies (29%) reported barriers and facilitators to including PPI in stroke research. Organization, authentic partnership, and experienced PPI representatives were common facilitators and identified barriers reflected concerns around adequate funding, time required, and diversity in perspectives. A positive reporting bias for PPI impact was observed, summarized as keeping the patient perspective central to the research process, improved care of study participants, validation of study findings, and improved communication/lay-summaries of complex research concepts.

CONCLUSIONS

PPI is underutilized and inconsistently reported in current empirical stroke research. PPI must become more widely adopted, notably in low- and middle-income countries. Consensus-driven standards for inclusion of PPI by funding organizations and publishers are required to support its widespread adoption.

Validation of the brain injury associated visual impairment - impact questionnaire (BIVI-IQ)

PURPOSE

The Brain Injury associated Visual Impairment - Impact Questionnaire (BIVI-IQ) was developed to assess the impact of post-stroke visual impairment. The development of the questionnaire used robust methods involving stroke survivors and clinicians. The aim of this study was to assess the validity of the BIVI-IQ in a stroke population.

METHODS

Stroke survivors with visual impairment were recruited from stroke units, outpatient clinics and non-healthcare settings. Participants were asked to complete questionnaire sets on three separate occasions; the BIVI-IQ at each visit with additional questionnaires at baseline and visit 2. Vision assessment and anchor questions from participants and clinicians were collected. The analysis included assessment of missing data, acceptability, Rasch model analysis, test-retest reliability, construct validity (NEI VFQ-25, EQ-5D-5L) and responsiveness to change.

RESULTS

316 stroke survivors completed at least one questionnaire of the 326 recruited. Mean age was 67 years and 64% were male. Adequate fit statistics to the Rasch model were reached (χ2 = 73.12, p = 0.02) with two items removed and thresholds of two adjusted, indicating validity and unidimensionality. Excellent test-retest reliability was demonstrated (ICC = 0.905) with a 3-month interval. Construct validity was demonstrated with a strong significant correlation to the NEI VFQ-25 (r = 0.837, p < 0.01). The BIVI-IQ also demonstrated responsiveness to change with significant differences identified between groups based on participant and clinician anchor questions (X2 = 23.29, p < 0.001; X2 = 24.56, p < 0.001).

CONCLUSION

The BIVI-IQ has been shown to be valid and practical for 'everyday' use by clinicians and researchers to monitor vision-related quality of life in stroke survivors with visual impairment.

Predicting motor gains with home-based telerehabilitation after stroke

INTRODUCTION

Telerehabilitation (TR) may be useful for rehabilitation therapy after stroke. However, stroke is a heterogeneous condition, and not all patients can be expected to derive the same benefit from TR, underscoring the need to identify predictors of response to TR.

METHODS

A prior trial provided patients with 6 weeks of intensive rehabilitation therapy targeting arm movement, randomly assigned to be provided in the home via TR (current focus) or in clinic. Eligible patients had moderate arm motor deficits and were in the subacute-chronic stage post stroke. Behavioral gains were measured as change in the arm motor Fugl-Meyer score from baseline to 30 days post therapy. To delineate predictors of TR response, multivariable linear regression was performed, advancing the most significant predictor from each of eight categories: patient demographics, stroke characteristics, medical history, rehabilitation therapy outside of study procedures, motivation, sensorimotor impairment, cognitive/affective deficits, and functional status.

RESULTS

The primary focus was on patients starting TR >90 days post stroke onset (n = 44), among whom female sex, less spasticity, and less visual field defects predicted greater motor gains. This model explained 39.3% of the variance in treatment-related gains. In secondary analysis that also included TR patients enrolled ≤90 days post stroke (total n = 59), only female sex was a predictor of treatment gains. A separate secondary analysis examined patients >90 days post stroke (n = 34) randomized to in-clinic therapy, among whom starting therapy earlier post stroke and less ataxia predicted greater motor gains.

DISCUSSION

Response to TR varies across patients, emphasizing the need to identify characteristics that predict treatment-related behavioral gain. The current study highlights factors that might be important to patient selection for home-based TR after stroke.

Neurological Health: Not Merely the Absence of Disease: Current Wellbeing Instruments Across the Spectrum of Neurology

OBJECTIVE

Well-being and quality of life can vary independently of disease. Instruments measuring well-being and quality of life are commonly used in neurology, but there has been little investigation into the extent in which they accurately measure wellbeing/quality of life or if they merely reflect a diseased state of an individual.

DESIGN

Systematic searches, thematic analysis and narrative synthesis were undertaken. Individual items from instruments represented in ≥ 5 publications were categorised independently, without prior training, by five neurologists and one well-being researcher, as relating to 'disease-effect' or 'Well-being' with a study-created instrument. Items were additionally categorised into well-being domains.

DATA SOURCES

MEDLINE, EMBASE, EMCARE and PsycINFO from 1990 to 2020 were performed, across the 13 most prevalent neurological diseases.

RESULTS

301 unique instruments were identified. Multiple sclerosis had most unique instruments at 92. SF-36 was used most, in 66 studies. 22 instruments appeared in ≥ 5 publications: 19/22 'well-being' outcome instruments predominantly measured disease effect (Fleiss kappa = .60). Only 1/22 instruments was categorised unanimously as relating to well-being. Instruments predominantly measured mental, physical and activity domains, over social or spiritual.

CONCLUSIONS

Most neurological well-being or quality-of-life instruments predominantly measure disease effect, rather than disease-independent well-being. Instruments differed widely in well-being domains examined.

The Natural History of Leber's Hereditary Optic Neuropathy in an Irish Population and Assessment for Prognostic Biomarkers

In this study we have assessed the clinical and genetic characteristics of an Irish Leber's hereditary optic neuropathy (LHON) cohort and assessed for useful biomarkers of visual prognosis. We carried out a retrospective review of clinical data of patients with genetically confirmed LHON presenting to an Irish tertiary referral ophthalmic hospital. LHON diagnosis was made on classic clinical signs with genetic confirmation. Alternate diagnoses were excluded with serological investigations and neuro-imaging. Serial logarithm of the minimum angle of resolution (logMAR) visual acuity (VA) was stratified into 'on-chart' for logMAR 1.0 or better and 'off-chart' if worse than logMAR 1.0. Serial optical coherence tomography scans of the retinal nerve fibre layer (RNFL) and ganglion cell complex (GCC) monitored structure. Idebenone-treated and untreated patients were contrasted. Statistical analyses were performed to assess correlations of presenting characteristics with final VA. Forty-four patients from 34 pedigrees were recruited, of which 87% were male and 75% harboured the 11778 mutation. Legal blindness status was reached in 56.8% of patients by final review (mean 74 months). Preservation of initial nasal RNFL was the best predictor of on-chart final VA. Females had worse final VA than males and patients presenting at < 20 years of age had superior final VA. Idebenone therapy (50% of cohort) yielded no statistically significant benefit to final VA, although study design precludes definitive comment on efficacy. The reported cases represent the calculated majority of LHON pedigrees in Ireland. Visual outcomes were universally poor; however, VA may not be the most appropriate outcome measure and certain patient-reported outcome measures may be of more use when assessing future LHON interventions.

Development and psychometric properties of the Multiple Sclerosis Knowledge Assessment Scale: Rasch analysis of a novel tool for evaluating MS knowledge

BACKGROUND

Multiple sclerosis (MS)-related knowledge is an important evaluation metric for health education interventions. However, few MS knowledge assessment tools are currently available for use.

OBJECTIVES

This study aims to develop a reliable and valid Multiple Sclerosis Knowledge Assessment Scale (MSKAS) for use in the MS community and the general public.

METHODS

The MSKAS was developed using a Delphi study methodology and was administered to participants in the first open enrolment of the Understanding Multiple Sclerosis (UMS) online course. Rasch analysis was used to examine its psychometric properties and develop the final scale.

RESULTS

Experts from across the MS community participated in the development of the MSKAS, resulting in an initial scale of 42 items. Five hundred and forty-three UMS participants completed the MSKAS; 89% were female and 30% were people with MS. The final unidimensional 22-item scale has a person separation index of 2.16, a person reliability index of 0.82, an item separation index of 11.19, and a Cronbach's alpha (kr-20) test reliability of 0.87.

CONCLUSION

The MSKAS is a unidimensional scale with good construct validity and internal consistency. The MSKAS has the potential to be useful for the assessment of MS knowledge in research and clinical practice.