Properties of proxy-derived modified Rankin Scale assessment

Reliability of proxy reports on patient reported outcomes measures in stroke: An updated systematic review

OBJECTIVES

With the rising global burden of stroke-related morbidity, and increased focus on patient-centered healthcare, patient reported outcome measures (PROMs) are increasingly used to inform healthcare decision-making. Some stroke patients with cognitive or motor impairments are unable to respond to PROMs, so proxies may respond on their behalf; the reliability of which remains unclear. The aim of the study is to update a 2010 systematic review to investigate the inter-rater reliability of proxy respondents answering PROMs for stroke patients.

MATERIALS AND METHODS

Studies on the reliability of proxy respondents in stroke were searched within CINAHL, Embase, PsycInfo, and WoS databases (01/07/22, 08/07/22). Fifteen studies were included for review. ICC and k-statistic were extracted for PROMs scales and categorized as poor (0.80). Bias was assessed using the CCAT.

RESULTS

Five studies reported PROMs with inter-rater reliability scores ranging from 0.80. Two studies reported activities of daily living (ADLs) scores ranging from 0.41 to 0.80 and 8 studies reported quality of life (QoL) measures with scores ranging from 0.80. Subcategories of these scales included physical (ICC/k-statistic 0.41- >0.8), cognitive (ICC/k-statistic 0.40-0.80), communication (ICC/k-statistic <0.4-0.80,) and psychological (ICC/k-statistic <0.40-0.60) measures.

CONCLUSIONS

Proxy respondents are reliable sources for PROM reports on physical domains in ADLs, PROMs and QoL scales. Proxy reports for measures of communication and psychological domains had greater variability in reliability scores, ranging from poor to substantial; hence, caution should be applied when interpreting proxy reports for these domains.

Outcomes and safety of endovascular treatment from 6 to 24 hours in patients with a pre-stroke moderate disability (mRS 3): a multicenter retrospective study

BACKGROUND

Approximately 30% of patients presenting with acute ischemic stroke (AIS) due to large vessel occlusion have pre-stroke modified Rankin Scale (mRS) scores ≥2. We aimed to investigate the safety and outcomes of endovascular treatment (EVT) in patients with AIS with moderate pre-stroke disability (mRS score 3) in an extended time frame (ie, 6-24 hours from the last time known well).

METHODS

Data were collected from five centers in Europe and the USA from January 2018 to January 2023 and included 180 patients who underwent EVT in an extended time frame. Patients were divided into two groups of 90 each (Group 1: pre-mRS 0-2; Group 2: pre-mRS 3; 71% women, mean age 80.3±11.9 years). Primary outcomes were: (1) 3-month good clinical outcome (Group 1: mRS 0-2, Group 2: mRS 0-3) and ΔmRS; (2) any hemorrhagic transformation (HT); and (3) symptomatic HT. Secondary outcomes were successful and complete recanalization after EVT and 3-month mortality.

RESULTS

No between-group differences were found in the 3-month good clinical outcome (26.6% vs 25.5%, P=0.974), any HT (26.6% vs 22%, P=0.733), and symptomatic HT (8.9 vs 4.4%, P=0.232). Unexpectedly, ΔmRS was significantly smaller in Group 2 compared with Group 1 (1.64±1.61 vs 2.97±1.69, P<0.001). No between-group differences were found in secondary outcomes.

CONCLUSION

Patients with pre-stroke mRS 3 are likely to have similar outcomes after EVT in the extended time frame to those with pre-stroke mRS 0-2, with no difference in safety.

Clinical outcome of patients with mild pre-stroke morbidity following endovascular treatment: a HERMES substudy

BACKGROUND

Analyses of the effect of pre-stroke functional levels on the outcome of endovascular therapy (EVT) have focused on the course of patients with moderate to substantial pre-stroke disability. The effect of complete freedom from pre-existing disability (modified Rankin Scale (mRS) 0) versus predominantly mild pre-existing disability/symptoms (mRS 1-2) has not been well delineated.

METHODS

The HERMES meta-analysis pooled data from seven randomized trials that tested the efficacy of EVT. We tested for a multiplicative interaction effect of pre-stroke mRS on the relationship between treatment and outcomes. Ordinal regression was used to assess the association between EVT and 90-day mRS (primary outcome) in the subgroup of patients with pre-stroke mRS 1-2. Multivariable regression modeling was then used to test the effect of mild pre-stroke disability/symptoms on the primary and secondary outcomes (delta-mRS, mRS 0-2/5-6) compared with patients with pre-stroke mRS 0.

RESULTS

We included 1764 patients, of whom 199 (11.3%) had pre-stroke mRS 1-2. No interaction effect of pre-stroke mRS on the relationship between treatment and outcome was observed. Patients with pre-stroke mRS 1-2 had worse outcomes than those with pre-stroke mRS 0 (adjusted common OR (acOR) 0.53, 95% CI 0.40 to 0.70). Nonetheless, a significant benefit of EVT was observed within the mRS 1-2 subgroup (cOR 2.08, 95% CI 1.22 to 3.55).

CONCLUSIONS

Patients asymptomatic/without disability prior to onset have better outcomes following EVT than patients with mild disability/symptoms. Patients with pre-stroke mRS 1-2, however, more often achieve good outcomes with EVT compared with conservative management. These findings indicate that mild pre-existing disability/symptoms influence patient prognosis after EVT but do not diminish the EVT treatment effect.

Efficacy and safety of mechanical thrombectomy in acute stroke patients with pre-morbid disability

INTRODUCTION –

Patients with pre-morbid disability have been generally excluded from randomized controlled trials of mechanical thrombectomy for acute ischemic stroke. However, stroke physicians commonly encounter such patients in practice, and face challenging treatment decisions when caring for them.

AREAS COVERED –

We review the literature on the safety and efficacy of thrombectomy in patients with pre-morbid disability. Recent clinical-epidemiological studies have highlighted the adverse outcomes that come with each increment of additional post-stroke disability in these patients. Several observational studies - both case series and registry-based studies - have helped demonstrate the comparable safety of thrombectomy in patients with pre-morbid disability as in those without, complementing similar data on thrombolysis. These data also suggest similar rates of successful recanalization, symptomatic intracerebral hemorrhage, and return to pre-stroke level of disability when treated with mechanical thrombectomy, although they have higher mortality.

EXPERT OPINION –

In the absence of high-quality evidence, we recommend pursuing shared decision-making with patients or family members and being upfront about the uncertain evidence. Available observational data underline the potential for a substantial proportion of these patients to return to their pre-morbid state, do not indicate a greater rate of treatment-related complications, and do not support routinely excluding these patients from thrombectomy.

Endovascular Treatment and Thrombolysis for Acute Ischemic Stroke in Patients With Premorbid Disability or Dementia: A Scientific Statement From the American Heart Association/American Stroke Association

Patients with premorbid disability or dementia have generally been excluded from randomized controlled trials of reperfusion therapies such as thrombolysis and endovascular therapy for acute ischemic stroke. Consequently, stroke physicians face treatment dilemmas in caring for such patients. In this scientific statement, we review the literature on acute ischemic stroke in patients with premorbid disability or dementia and propose principles to guide clinicians, clinician-scientists, and policymakers on the use of acute stroke therapies in these populations. Recent clinical-epidemiological studies have demonstrated challenges in our concept and measurement of premorbid disability or dementia while highlighting the significant proportion of the general stroke population that falls under this umbrella, risking exclusion from therapies. Such studies have also helped clarify the adverse long-term clinical and health economic consequences with each increment of additional poststroke disability in these patients, underscoring the importance of finding strategies to mitigate such additional disability. Several observational studies, both case series and registry-based studies, have helped demonstrate the comparable safety of endovascular therapy in patients with premorbid disability or dementia and in those without, complementing similar data on thrombolysis. These data also suggest that such patients have a substantial potential to retain their prestroke level of disability when treated, despite their generally worse prognosis overall, although this remains to be validated in higher-quality registries and clinical trials. By pairing pragmatic and transparent decision-making in clinical practice with an active pursuit of high-quality research, we can work toward a more inclusive paradigm of patient-centered care for this often-neglected patient population.

Inter-method reliability of the modified Rankin Scale in patients with subarachnoid hemorrhage

Background and objectives

The modified Rankin Scale (mRS) is one of the most frequently used outcome measures in trials in patients with an aneurysmal subarachnoid hemorrhage (aSAH). The assessment method of the mRS is often not clearly described in trials, while the method used might influence the mRS score. The aim of this study is to evaluate the inter-method reliability of different assessment methods of the mRS.

Methods

This is a prospective, randomized, multicenter study with follow-up at 6 weeks and 6 months. Patients aged ≥ 18 years with aSAH were randomized to either a structured interview or a self-assessment of the mRS. Patients were seen by a physician who assigned an mRS score, followed by either the structured interview or the self-assessment. Inter-method reliability was assessed with the quadratic weighted kappa score and percentage of agreement. Assessment of feasibility of the self-assessment was done by a feasibility questionnaire.

Results

The quadratic weighted kappa was 0.60 between the assessment of the physician and structured interview and 0.56 between assessment of the physician and self-assessment. Percentage agreement was, respectively, 50.8 and 19.6%. The assessment of the mRS through a structured interview and by self-assessment resulted in systematically higher mRS scores than the mRS scored by the physician. Self-assessment of the mRS was proven feasible.

Discussion

The mRS scores obtained with different assessment methods differ significantly. The agreement between the scores is low, although the reliability between the assessment methods is good. This should be considered when using the mRS in clinical trials.

Trial registration

www.trialregister.nl; Unique identifier: NL7859.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00415-021-10880-4.

Different Stroke Scales; Which Scale or Scales Should Be Used?

BACKGROUND

There has been a considerable development in the clinometric of stroke. But researchers are concerned that some scales are too generic, inherently and the insight may not be provided. The current study was conducted to determine which scale or scales should be used in stroke survivors.

METHODS

We selected 67 studies which were published between January 2010 and December 2018 from Up to date, CINAHL, ProQuest, Scopus, PubMed, Embase, Medline, Elsevier and Web of Science with MeSH terms. Inclusion criteria were: clinical trials, prospective studies, retrospective cohort studies, or cross-sectional studies; original research in adult human stroke survivors. We excluded the following articles: non-adult population; highly selected studies or treatment studies without incidence data; commentaries, single case reports, review article, editorials and non-English articles or articles without full text available.

RESULTS

Face Arm Speech Test and Cincinnati Pre-Hospital Stroke Scale scales because it was easy to learn and rapidly administer the recommended dose to use in pre-hospital, but there are not gold standard in stroke diagnosis in Pre-Hospital. National Institutes of Health Stroke Scale valuable in the acute stage for middle cerebral artery, not chronic or long term post stroke outcome. The Barthel Index scores for approximately three weeks could predict activities of daily living disabilities in 6 months.

CONCLUSION

Every scale has an advantage and a disadvantage and we were not able to introduce the gold standard for each item, but some special scales were used more in the studies, preferred for comparing with other studies to match the research results.

Measuring stroke outcomes for 74 501 patients using linked administrative data: System-wide estimates and validation of 'home-time' as a surrogate measure of functional status

AIMS

Administrative data offer cost-effective, whole-of-population stroke surveillance yet the lack of validated measures of functional status is a shortcoming. The number of days spent living at home after stroke ('home-time') is a patient-centred outcome that can be objectively ascertained from administrative data. Population-based validation against both severity and outcome measures and for all subtypes is lacking. We aimed to report representative 'home-time' estimates and validate 'home-time' as a surrogate measure of functional status after stroke.

METHODS

Stroke hospitalisations from a state-wide census in New South Wales, Australia, from January 1, 2005 to March 31, 2014 were linked to prehospital data, poststroke admissions and deaths. We correlated 90-day 'home-time' with Glasgow Coma Scale (GCS) scores, measured upon a patient's initial contact with paramedics and Functional Independence Measure (FIM) scores, measured upon entry to rehabilitation after the acute hospital stroke admission. Negative binomial regressions identified predictors of 'home-time'.

RESULTS

Patients with stroke (N = 74 501) spent a median of 53 days living at home 90 days after the event. Median 'home-time' was 60 days after ischaemic stroke, 49 days after subarachnoid haemorrhage and 0 days after intracerebral haemorrhage. GCS and FIM scores significantly correlated with 'home-time' (P < .001). Women spent significantly less time at home compared with men after stroke, although being married increased 'home-time' after ischaemic stroke and subarachnoid haemorrhage.

CONCLUSIONS

These findings underscore the immediate and adverse impact of stroke. 'Home-time' measured using administrative data is a robust, replicable and valid patient-centred outcome enabling inexpensive population-based surveillance and system-wide quality assessment.

An international, consensus-derived Core Outcome Set for Cardiac Arrest effectiveness trials: the COSCA initiative

PURPOSE OF REVIEW

Accurate and relevant assessment is essential to determining the impact of ill-health and the relative benefit of healthcare. This review details the recent development of a core outcome set for cardiac arrest effectiveness trials - the COSCA initiative.

RECENT FINDINGS

The reported heterogeneity in outcome assessment and a lack of outcome reporting guidance were key triggers for the development of the COSCA. The historical failure of existing research to adequately capture the perspective of survivors and their family members in defining survival is described. Working collaboratively with international stakeholders - including survivors, family members and advocates - as research partners and participants ensured that a range of perspectives were considered throughout all stages of COSCA development. Three core domains and methods of assessment were recommended: survival - at 30 days or hospital discharge; neurological function assessed at 30 days or hospital discharge with the modified Rankin Scale; and health-related quality of life assessed at 90 days (as a minimum) with one of three generic measures.

SUMMARY

The COSCA recommendation describes a small group of outcomes that should be reported as a minimum across large, randomized clinical effectiveness trials for cardiac arrest.

COSCA (Core Outcome Set for Cardiac Arrest) in Adults: An Advisory Statement From the International Liaison Committee on Resuscitation

Cardiac arrest effectiveness trials have traditionally reported outcomes that focus on survival. A lack of consistency in outcome reporting between trials limits the opportunities to pool results for meta-analysis. The COSCA initiative (Core Outcome Set for Cardiac Arrest), a partnership between patients, their partners, clinicians, research scientists, and the International Liaison Committee on Resuscitation, sought to develop a consensus core outcome set for cardiac arrest for effectiveness trials. Core outcome sets are primarily intended for large, randomized clinical effectiveness trials (sometimes referred to as pragmatic trials or phase III/IV trials) rather than for pilot or efficacy studies. A systematic review of the literature combined with qualitative interviews among cardiac arrest survivors was used to generate a list of potential outcome domains. This list was prioritized through a Delphi process, which involved clinicians, patients, and their relatives/partners. An international advisory panel narrowed these down to 3 core domains by debate that led to consensus. The writing group refined recommendations for when these outcomes should be measured and further characterized relevant measurement tools. Consensus emerged that a core outcome set for reporting on effectiveness studies of cardiac arrest (COSCA) in adults should include survival, neurological function, and health-related quality of life. This should be reported as survival status and modified Rankin scale score at hospital discharge, at 30 days, or both. Health-related quality of life should be measured with ≥1 tools from Health Utilities Index version 3, Short-Form 36-Item Health Survey, and EuroQol 5D-5L at 90 days and at periodic intervals up to 1 year after cardiac arrest, if resources allow.

Functional Assessment for Acute Stroke Trials: Properties, Analysis, and Application

A measure of treatment effect is needed to assess the utility of any novel intervention in acute stroke. For a potentially disabling condition such as stroke, outcomes of interest should include some measure of functional recovery. There are many functional outcome assessments that can be used after stroke. In this narrative review, we discuss exemplars of assessments that describe impairment, activity, participation, and quality of life. We will consider the psychometric properties of assessment scales in the context of stroke trials, focusing on validity, reliability, responsiveness, and feasibility. We will consider approaches to the analysis of functional outcome measures, including novel statistical approaches. Finally, we will discuss how advances in audiovisual and information technology could further improve outcome assessment in trials.

How well do standard stroke outcome measures reflect quality of life? A retrospective analysis of clinical trial data

BACKGROUND AND PURPOSE

Quality of life (QoL) is important to stroke survivors yet is often recorded as a secondary measure in acute stroke randomized controlled trials. We examined whether commonly used stroke outcome measures captured aspects of QoL.

METHODS

We examined primary outcomes by National Institutes of Health Stroke Scale (NIHSS), Barthel Index (BI) and modified Rankin Scale (mRS), and QoL by Stroke Impact Scale (SIS) and European Quality of Life Scale (EQ-5D) from the Virtual International Stroke Trials Archive (VISTA). Using Spearman correlations and logistic regression, we described the relationships between QoL mRS, NIHSS, and BI at 3 months, stratified by respondent (patient or proxy). Using χ2 analyses, we examined the mismatch between good primary outcome (mRS ≤1, NIHSS ≤5, or BI ≥95) but poor QoL, and poor primary outcome (mRS ≥3, NIHSS ≥20, or BI ≤60) but good QoL.

RESULTS

Patient-assessed QoL had a stronger association with mRS (EQ-5D weighted score n=2987, P<0.0001, r=-0.7, r2=0.53; SIS recovery n=2970, P<0.0001, r=-0.71, r2=0.52). Proxy responses had a stronger association with BI (EQ-5D weighted score n=837, P<0.0001, r=0.78, r2=0.63; SIS recovery n=867, P<0.0001, r=0.68, r2=0.48). mRS explained more of the variation in QoL (EQ-5D weighted score=53%, recovery by SIS v3.0=52%) than NIHSS or BI and resulted in fewer mismatches between good primary outcome and poor QoL (P<0.0001, EQ-5D weighted score=8.5%; SIS recovery=10%; SIS-16=4.4%).

CONCLUSIONS

The mRS seemed to align closely with stroke survivors' interests, capturing more information on QoL than either NIHSS or BI. This further supports its recommendation as a primary outcome measure in acute stroke randomized controlled trials.

Assessment scales in stroke: clinimetric and clinical considerations

As stroke care has developed, there has been a need to robustly assess the efficacy of interventions both at the level of the individual stroke survivor and in the context of clinical trials. To describe stroke-survivor recovery meaningfully, more sophisticated measures are required than simple dichotomous end points, such as mortality or stroke recurrence. As stroke is an exemplar disabling long-term condition, measures of function are well suited as outcome assessment. In this review, we will describe functional assessment scales in stroke, concentrating on three of the more commonly used tools: the National Institutes of Health Stroke Scale, the modified Rankin Scale, and the Barthel Index. We will discuss the strengths, limitations, and application of these scales and use the scales to highlight important properties that are relevant to all assessment tools. We will frame much of this discussion in the context of "clinimetric" analysis. As they are increasingly used to inform stroke-survivor assessments, we will also discuss some of the commonly used quality-of-life measures. A recurring theme when considering functional assessment is that no tool suits all situations. Clinicians and researchers should chose their assessment tool based on the question of interest and the evidence base around clinimetric properties.