Practice based evidence: incorporating clinical heterogeneity and patient-reported outcomes for comparative effectiveness research

A Comparative Effectiveness Study of Speech and Surgical Outcomes: Study Overview

AIMS

To provide an overview of the Cleft Outcomes Research NETwork (CORNET) and the CORNET Speech and Surgery study. The study is (1) comparing speech outcomes and fistula rate between two common palate repair techniques, straight-line closure with intra-velar veloplasty (IVVP) and Furlow Double-Opposing Z-palatoplasty (Furlow Z-plasty); (2) summarizing practice variation in the utilization of early intervention speech-language (EI-SL) services; and (3) exploring the association between EI-SL services and speech outcomes.

DESIGN

Prospective, longitudinal, observational, comparative effectiveness, multi-center.

SITES

Twenty sites across the United States.

PARTICIPANTS

One thousand two hundred forty-seven children with cleft palate with or without cleft lip (CP ± L). Children with submucous cleft palate or bilateral sensorineural severe to profound hearing loss were excluded from participation.

INTERVENTIONS

Straight-line closure with IVVP or Furlow Z-plasty based on each surgeon's standard clinical protocol.

MAIN OUTCOME MEASURE(S)

The primary study outcome is perceptual ratings of hypernasality judged from speech samples collected at 3 years of age. Secondary outcomes are fistula rate, measures of speech production, and quality of life. The statistical analyses will include generalized estimating equations with propensity score weighting to address potential confounders.

CURRENT PROGRESS

Recruitment was completed in February 2023; 80% of children have been retained to date. Five hundred sixty two children have completed their final 3-year speech assessment. Final study activities will end in early 2025.

CONCLUSIONS

This study addresses long-standing questions related to the effectiveness of the two most common palatoplasty approaches and describes CORNET which provides an infrastructure that will streamline future studies in all areas of cleft care.

Combined surveillance and treatment register for children with cerebral palsy: the protocol of the Netherlands CP register

INTRODUCTION

Cerebral palsy (CP) is a childhood onset, lifelong, condition. Early detection and timely treatment of potential problems during the child's development are important to prevent secondary impairments and improve function. Clinical management of children with CP requires a spectrum of multidisciplinary interventions, which have an impact on short-term and long-term outcomes. However, there is a lack of knowledge about a personalised approach in this heterogeneous population. Various CP registers with different aims have been developed worldwide, which has made an important contribution to our understanding of CP. The purpose of this protocol is to describe the unique design of a combined multidisciplinary surveillance and treatment register for children with CP in the Netherlands, which aims to improve quality of care and to enhance an individual treatment approach.

METHODS AND ANALYSIS

The Netherlands CP Register combines a multidisciplinary surveillance programme with a standardised protocol for treatment registry. The register systematically collects real-life surveillance and treatment data of children with CP. The register contributes to daily care at the individual level by screening for potential secondary impairments using a decision-support tool, by visualising individual development using a dashboard, and by supporting goal setting and shared decision-making for interventions. The register provides a platform at the national level for quality of care improvement and a comprehensive database of real-life data allowing multicentre studies with a long-term follow-up. People with lived experience of CP, healthcare professionals from different disciplines and researchers collaborated in the development of the register.

ETHICS AND DISSEMINATION

The Netherlands CP register was submitted to the Medical Ethics Review Committee of VU University Medical Center (Amsterdam, the Netherlands), who judged the register not to be subject to the Medical Research Involving Human Subjects Act. A scientific board reviews requests for dissemination of data from the register for specific research questions.

Classification and Quantification of Physical Therapy Interventions across Multiple Neurological Disorders: An Italian Multicenter Network

Despite their relevance in neurorehabilitation, physical therapy (PT) goals and interventions are poorly described, compromising a proper understanding of PT effectiveness in everyday clinical practice. Thus, this paper aims to describe the prevalence of PT goals and interventions in people with neurological disorders, along with the participants' clinical features, setting characteristics of the clinical units involved, and PT impact on outcome measures. A multicenter longitudinal observational study involving hospitals and rehabilitation centers across Italy has been conducted. We recruited people with stroke (n = 119), multiple sclerosis (n = 48), and Parkinson's disease (n = 35) who underwent the PT sessions foreseen by the National Healthcare System. Clinical outcomes were administered before and after the intervention, and for each participant the physical therapists completed a semi-structured interview to report the goals and interventions of the PT sessions. Results showed that the most relevant PT goals were related to the ICF activities with "walking" showing the highest prevalence. The most used interventions aimed at improving walking performance, followed by those aimed at improving organ/body system functioning, while interventions targeting the cognitive-affective and educational aspects have been poorly considered. Considering PT effectiveness, 83 participants experienced a clinically significant improvement in the outcome measures assessing gait and balance functions.

Staff training in physical interventions: a literature review

Background

Restrictive practices are used frequently by frontline staff in a variety of care contexts, including psychiatric hospitals, children's services, and support services for older adults and individuals with intellectual and developmental disabilities. Physical restraint has been associated with emotional harm, physical injury to staff and consumers, and has even resulted in death of individuals in care environments. Various interventions have been implemented within care settings with the intention of reducing instances of restraint. One of the most common interventions is staff training that includes some physical intervention skills to support staff to manage crisis situations. Despite physical intervention training being used widely in care services, there is little evidence to support the effectiveness and application of physical interventions. This review will examine the literature regarding outcomes of staff training in physical interventions across care sectors.

Method

A systematic search was conducted following PRISMA guidelines using Cochrane Database, Medline EBSCO, Medline OVID, PsychINFO, and the Web of Science. Main search keywords were staff training, physical intervention, physical restraint. The MMAT was utilised to provide an analytical framework for the included studies.

Results and discussion

Seventeen articles have been included in this literature review. The included studies take place in a range of care settings and comprise a wide range of outcomes and designs. The training programmes examined vary widely in their duration, course content, teaching methods, and extent to which physical skills are taught. Studies were of relatively poor quality. Many descriptions of training programmes did not clearly operationalise the knowledge and skills taught to staff. As such, it is difficult to compare course content across the studies. Few papers described physical interventions in sufficient detail. This review demonstrates that, although staff training is a 'first response' to managing health and safety in care settings, there is very little evidence to suggest that staff training in physical intervention skills leads to meaningful outcomes.

Generating Practice-Based Evidence in the Use of Guideline-Recommended Combination Therapy for Secondary Prevention of Acute Myocardial Infarction

Background: Clinical guidelines recommend beta-blockers, angiotensin-converting enzyme inhibitors/angiotensin-receptor blockers, and statins for the secondary prevention of acute myocardial infarction (AMI). It is not clear whether variation in real-world practice reflects poor quality-of-care or a balance of outcome tradeoffs across patients. Methods: The study cohort included Medicare fee-for-service beneficiaries hospitalized 2007-2008 for AMI. Treatment within 30-days post-discharge was grouped into one of eight possible combinations for the three drug classes. Outcomes included one-year overall survival, one-year cardiovascular-event-free survival, and 90-day adverse events. Treatment effects were estimated using an Instrumental Variables (IV) approach with instruments based on measures of local-area practice style. Pre-specified data elements were abstracted from hospital medical records for a stratified, random sample to create "unmeasured confounders" (per claims data) and assess model assumptions. Results: Each drug combination was observed in the final sample (N = 124,695), with 35.7% having all three, and 13.5% having none. Higher rates of guideline-recommended treatment were associated with both better survival and more adverse events. Unmeasured confounders were not associated with instrumental variable values. Conclusions: The results from this study suggest that providers consider both treatment benefits and harms in patients with AMIs. The investigation of estimator assumptions support the validity of the estimates.

Personal factors understood through the Ecological-Enactive Model of Disability and implications for rehabilitation research

The International Classification of Functioning, Disability and Health (ICF) recognizes that disability arises from the interaction between an individual with a medical condition and the context in which they are embedded. Context in the ICF is comprised of environmental and personal factors. Personal factors, the background life and lifestyle of an individual, are poorly understood in rehabilitation. There is limited knowledge about how personal and environmental factors interact to shape the contextual conditions critical for explaining functioning and disability. In this paper, we explore how a newly proposed model of disability, the Ecological-Enactive Model of Disability, can enhance understanding of personal factors across multiple rehabilitation disciplines. We draw from a review of evidence and phenomenological interviews of individuals with Friedreich's Ataxia. We consider the practical impact of this understanding on disability and rehabilitation research and pathways for the future focusing on representative design.

Development of employment indicators to advance the quality of spinal cord injury rehabilitation care: SCI-High Project

CONTEXT

Employment and Return to Work (RTW) rates following spinal cord injury/disease (SCI/D) are low due to individual and impairments characteristics, secondary health conditions, social and environmental barriers, prior work experience, workplace supports and resources, and physical or psychosocial work demands. To improve RTW, the SCI-High Project team developed a set of Employment structure, process, and outcome indicators for adults with SCI/D in the first 18 months after rehabilitation admission.

METHODS

A pan-Canadian Working Group of diverse stakeholders: (1) defined the Employment construct; (2) conducted a systematic search of available outcomes measures; (3) constructed a Driver diagram summarizing factors associated with employment. Subsequent facilitated meetings allowed for the creation of structure and process indicators, and the selection of outcome indicators.

RESULTS

The structure indicator is the proportion of SCI/D rehabilitation programs with an employment resource center. The process indicator is the proportion of SCI/D rehabilitation inpatients who receive an employment assessment during inpatient rehabilitation. The intermediary and final outcome measures are the Readiness for Return-to-Work Scale (RRTW) and Work Productivity and Activity Impairment (WPAI). Scale A of the RRTW for those who are unemployed and Scale B of RRTW and WPAI will be used for those who are employed.

CONCLUSION

This framework of Employment indicators intends to support the RTW needs of persons with SCI/D by ensuring that rehabilitation professionals provide opportunities to explore RTW within the first 18 months after rehab admission. Increased employment rates have the potential to enhance the wellbeing, health, and longevity of individuals with SCI/D.

Relationship of patient characteristics and inpatient rehabilitation services to 5-year outcomes following spinal cord injury: A follow up of the SCIRehab project

OBJECTIVE

To examine associations of patient characteristics and treatment quantity delivered during inpatient spinal cord injury (SCI) rehabilitation with outcomes at 5 years post-injury and compare them to the associations found at 1 year post-injury.

DESIGN

Observational study using Practice-Based Evidence research methodology in which clinicians documented treatment details. Regression modeling was used to predict outcomes.

SETTING

Five inpatient SCI rehabilitation centers in the US.

PARTICIPANTS

Participants were 792 SCIRehab participants who were >12 years of age, gave informed consent, and completed both a 1-year and 5-year post-injury interview.

OUTCOME MEASURES

Outcome data were derived from Spinal Cord Injury Model Systems (SCIMS) follow-up interviews at 5 years post-injury and, similar to the 1-year SCIMS outcomes, included measures of physical independence, societal participation, life satisfaction, and depressive symptoms, as well as place of residence, school/work attendance, rehospitalization, and presence of pressure ulcers.

RESULTS

Consistent with 1-year findings, patient characteristics continue to be strong predictors of outcomes 5-years post-injury, although several variables add to the prediction of some of the outcomes. More time in physical therapy and therapeutic recreation were positive predictors of 1-year outcomes, which held less true at 5 years. Greater time spent with psychology and social work/case management predicted greater depressive symptomatology 5-years post-injury. Greater clinician experience was a predictor at both 1- and 5 -years, although the related positive outcomes varied across years.

CONCLUSION

Various outcomes 5-years post-injury were primarily explained by pre-and post-injury characteristics, with little additional variance offered by the quantity of treatment received during inpatient rehabilitation.

Quasi-Contextualized Speech Treatment in Traumatic Brain Injury Inpatient Rehabilitation: Effects on Outcomes During the First Year After Discharge

OBJECTIVE

To evaluate the effect of providing quasi-contextualized speech therapy, defined as metacognitive, compensatory, or strategy training applied to cognitive and language impairments to facilitate the performance of future real-life activities, on functional outcomes up to 1 year following traumatic brain injury (TBI).

SETTING

Acute inpatient rehabilitation.

PARTICIPANTS

Patients enrolled during the TBI-Practice-Based Evidence (TBI-PBE) study (n = 1760), aged 14 years or older, who sustained a severe, moderate, or complicated mild TBI, received speech therapy in acute inpatient rehabilitation at one of 9 US sites, and consented to follow-up 3 and 9 months postdischarge from inpatient rehabilitation.

DESIGN

Propensity score methods applied to a database consisting of multisite, prospective, longitudinal observational data.

MAIN MEASURES

Participation Assessment with Recombined Tools-Objective-17, FIM Motor and Cognitive scores, Satisfaction With Life Scale, and Patient Health Questionnaire-9.

RESULTS

When at least 5% of therapy time employed quasi-contextualized treatment, participants reported better community participation during the year following discharge. Quasi-contextualized treatment was also associated with better motor and cognitive function at discharge and during the year after discharge. The benefit, however, may be dependent upon a balance of rehabilitation time that relied on contextualized treatment.

CONCLUSIONS

The use of quasi-contextualized treatment may improve outcomes. Care should be taken, however, to not provide quasi-contextualized treatment at the expense of contextualized treatment.

Cognitive Change and Relaxation as Key Mechanisms of Treatment Outcome in Chronic Pain: Evidence From Routine Care

Despite effective treatment approaches within the cognitive behavioral framework general treatment effects for chronic pain are rather small to very small. Translation from efficacy trials to naturalistic settings is questionable. There is an urgent need to improve the effectiveness of well-established treatments, such as cognitive-behavior therapy (CBT) and the investigation of mechanisms of change is a promising opportunity. We performed secondary data analysis from routine data of 1,440 chronic pain patients. Patients received CBT in a multidisciplinary setting in two inpatient clinics. Effect sizes and reliable change indices were computed for pain-related disability and depression. The associations between changes in the use of different pain coping skills (cognitive restructuring, activity despite pain, relaxation techniques and mental distraction) and changes in clinical outcomes were analyzed in structural equation models. Pre-post effect sizes range from g = 0.47 (disability) to g = 0.89 (depression). Changes in the use of cognitive restructuring, relaxation and to a lesser degree mental distraction were associated with changes in disability and depression. Effects from randomized trials can be translated to naturalistic settings. The results complement experimental research on mechanisms of change in the treatment of chronic pain and indicate an important role of cognitive change and relaxation as mechanisms of change. Our findings cautiously suggest that clinicians should optimize these processes in chronic pain patients to reduce their physical and emotional disability.

Physical Activity Monitoring Using a Fitbit Device in Ischemic Stroke Patients: Prospective Cohort Feasibility Study

Background

Continuous tracking of ambulatory activity in real-world settings using step activity monitors has many potential uses. However, feasibility, accuracy, and correlation with performance measures in stroke patients have not been well-established.

Objective

The primary study objective was to determine adherence with wearing a consumer-grade step activity monitor, the Fitbit Charge HR, in home-going ischemic stroke patients during the first 90 days after hospital discharge. Secondary objectives were to (1) determine accuracy of step counts of the Fitbit Charge HR compared with a manual tally; (2) calculate correlations between the Fitbit step counts and the mobility performance scores at discharge and 30 days after stroke; (3) determine variability and change in weekly step counts over 90 days; and (4) evaluate patient experience with using the Fitbit Charge HR poststroke.

Methods

A total of 15 participants with recent mild ischemic stroke wore a Fitbit Charge HR for 90 days after discharge and completed 3 mobility performance tests from the National Institutes of Health Toolbox at discharge and Day 30: (1) Standing Balance Test, (2) 2-Minute Walk Endurance Test, and (3) 4-Meter Walk Gait Speed Test. Accuracy of step activity monitors was assessed by calculating differences in steps recorded on the step activity monitor and a manual tally during 2-minute walk tests.

Results

Participants had a mean age of 54 years and a median modified Rankin scale score of 1. Mean daily adherence with step activity monitor use was 83.6%. Mean daily step count in the first week after discharge was 4376. Daily step counts increased slightly during the first 30 days after discharge (average increase of 52.5 steps/day; 95% CI 32.2-71.8) and remained stable during the 30-90 day period after discharge. Mean step count difference between step activity monitor and manual tally was –4.8 steps (–1.8%). Intraclass correlation coefficients for step counts and 2-minute walk, standing balance, and 4-meter gait speed at discharge were 0.41 (95% CI –0.14 to 0.75), –0.12 (95% CI –0.67 to 0.64), and 0.17 (95% CI –0.46 to 0.66), respectively. Values were similarly poor at 30 days.

Conclusions

The use of consumer-grade Fitbit Charge HR in patients with recent mild stroke is feasible with reasonable adherence and accuracy. There was poor correlation between step counts and gait speed, balance, and endurance. Further research is needed to evaluate the association between step counts and other outcomes relevant to patients, including patient-reported outcomes and measures of physical function.

Description of School-Based Physical Therapy Services and Outcomes for Students with Down Syndrome

Students with Down syndrome (DS) receive school-based physical therapy (SBPT), however little data exists regarding services and outcomes. Using a prospective observational cohort study our aim was to explore SBPT activities and interventions, and students' goal achievement of 46 students with DS, tracked by 17 physical therapists (PTs). PTs provided on average 24.0 min/week direct service and 11.6 min/week services on behalf of the student. The most frequent activities employed were physical education/recreation, mobility, and sitting/standing/transitions. The most frequent interventions implemented were neuromuscular, mobility, and musculoskeletal. Although students individually met 69.5% of their primary outcome goals, their achievement could not be explained by total minutes of either direct and minutes on behalf of SBPT, nor minutes spent in most frequent activity.

A Theory-Driven System for the Specification of Rehabilitation Treatments

The field of rehabilitation remains captive to the black-box problem: our inability to characterize treatments in a systematic fashion across diagnoses, settings, and disciplines, so as to identify and disseminate the active ingredients of those treatments. In this article, we describe the Rehabilitation Treatment Specification System (RTSS), by which any treatment employed in rehabilitation may be characterized, and ultimately classified according to shared properties, via the 3 elements of treatment theory: targets, ingredients, and (hypothesized) mechanisms of action. We discuss important concepts in the RTSS such as the distinction between treatments and treatment components, which consist of 1 target and its associated ingredients; and the distinction between targets, which are the direct effects of treatment, and aims, which are downstream or distal effects. The RTSS includes 3 groups of mutually exclusive treatment components: Organ Functions, Skills and Habits, and Representations. The last of these comprises not only thoughts and feelings, but also internal representations underlying volitional action; the RTSS addresses the concept of volition (effort) as a critical element for many rehabilitation treatments. We have developed an algorithm for treatment specification which is illustrated and described in brief. The RTSS stands to benefit the field in numerous ways by supplying a coherent, theory-based framework encompassing all rehabilitation treatments. Using a common framework, researchers will be able to test systematically the effects of specific ingredients on specific targets; and their work will be more readily replicated and translated into clinical practice.

Provider reliability with interventions for knee impairments: a preliminary investigation to facilitate development of an MDT-based knee intervention taxonomy

Objectives: The lack of a standardized intervention taxonomy in comparative effectiveness research trials has led to uncertainty regarding the management of individuals with knee impairments. Inconsistently and poorly defined interventions affect frontline-care providers' abilities to understand and assimilate research findings into practice. An intervention taxonomy could help overcome the lack of treatment specificity commonly found in research trials. Methods: In the present study, we aimed to develop a Mechanical Diagnosis and Therapy (MDT)-based taxonomy and test the levels of reliability between providers who currently manage individuals with knee impairments in a rehabilitation setting. A total of 182 participants accessed the study during the study period, in which 180 consented to participate and 59 completed the survey (98.9% participation rate; 32.7% completion rate). Results: A total of 89.8% of the participants who completed the survey were physical therapists. Fleiss kappa values for the primary, secondary, and tertiary categories were 0.90, 0.89, and 0.71, respectively. The results of our investigation suggest substantial to almost perfect levels of reliability for identifying diverse MDT-based knee interventions displayed in video and vignette format within a sample population primarily of physical therapists who currently manage individuals with knee impairments in a rehabilitation setting. Discussion: Our findings show acceptable levels of reliability and provide support for using this standardized MDT-based intervention taxonomy as a way to improve intervention specificity and generalizability in comparative effectiveness research. Level of Evidence: 5.

Pain pattern classification and directional preference are associated with clinical outcomes for patients with low back pain

Pain Pattern Classification (PPC) and Directional Preference (DP) have shown merit as reliable and predictable clinical solutions to help reduce the burden posed by low back pain (LBP). We conducted a prospective, observational cohort study to verify the association between PPC, DP, and clinical outcomes. We hypothesized that (1) patients who demonstrated DP Centralization (CEN) would have lower pain intensity and disability at follow-up than patients who demonstrated Non-DP Non-CEN, and (2) the prevalence of DP at first examination would be lowest for patients with chronic LBP and are greater than 65 years old. First examination and follow-up data were completed by 639 patients. Clinical outcome measures, including pain intensity and disability, were collected at first examination and follow-up. Baseline comparisons were made between groups with first examination data only and groups with first examination data and follow-up data. A Pearson's chi-squared test was used to determine differences in prevalence rates for the categorical variables, and two-sample t-tests were used for the continuous variables. A Turkey's range test was used to determine differences in follow-up pain intensity and disability for LBP dual-classifications. Multiple regression was used to investigate DP prevalence considering risk adjusted factors. Overall prevalence of DP was 84.5% and prevalence was lowest for patients with sub-acute symptoms. No significant difference existed for the prevalence of DP for patients based on age. Patients classified as DP CEN had, on average, 1.99 pain intensity units less than patients classified as Non-DP Non-CEN at follow-up. Patients classified as DP CEN had, on average, 3.43 RMDQ units less than patients classified as Non-DP Non-CEN at follow-up.These findings support previous reports, verifying the association between LBP dual-classification schemes and clinical outcomes.

Venous disease patient registries available in the United States

Patient registries are beneficial in that they allow the collection of prospective data focused on a specific medical issue. These registries give providers a "real-world" view of patient outcomes. Many medical disciplines have a long history of developing and using patient registries; the first patient registry for chronic venous disease in the United States was launched in 2011, fairly recently in comparison. Registries included in this review were identified by surveying members of major academic societies that focus on the care of chronic venous disease and by searching MEDLINE and Embase databases using Ovid interface. Medical directors of four of the five databases available in the United States completed a standard questionnaire, and the answers served as the basis for this review. This review is not a comparison of registries; it does, however, describe the common and unique features of four venous registries currently available in the United States with the purpose of increasing awareness of and fostering participation in these registries.

Regression-Based Approaches to Patient-Centered Cost-Effectiveness Analysis

Achieving comprehensive patient centricity in cost-effectiveness analyses (CEAs) requires a statistical approach that accounts for patients' preferences and clinical and demographic characteristics. Increased availability and accessibility of patient-level health-related utility data from clinical trials or observational database provide enhanced opportunities to conduct more patient-centered CEA. Regression-based approaches that incorporate patient-level data hold great promise for enhancing CEAs to be more patient centered; this paper provides guidance regarding two CEA approaches that apply regression-based approaches utilizing patient-level health-related utility and costs data. The first approach utilizes patient-reported preferences to determine patient-specific utility. This approach evaluates how individuals' unique clinical and demographic factors affect their utility and cost levels over the course of treatment. The underlying motivation of this approach is to produce CEA estimates that reflect patient-level utilities and costs while adjusting for socio-demographic and clinical factors to aid patient-centered coverage and treatment decision-making. In the second approach, patient utilities are estimated based on the clinically defined health states through which a patient may transition throughout the course of treatment. While this approach is grounded on the widely used Markov transition model, we refine the model to facilitate an enhancement in conducting regression-based analysis to achieve transparent understanding of differences in utilities and costs across diverse patient populations. We discuss the unique statistical challenges of each approach and describe how these analytical strategies are related to non-regression-based models in health services research.

Patient-Reported Outcomes and Opioid Use in Outpatients With Chronic Pain

The Weill Cornell Medical College Pain Registry database contains patient characteristics, treatments, and outcomes for a prospective cohort of 1,159 chronic pain patients who were seen at the Weill Cornell Medical College Pain Medicine outpatient clinic from July 8, 2011 to December 10, 2014. Patients aged 45 to 64 years comprised 43% followed by age ≥ 65 years at 37%. Fifty-eight percent were female. Average pain intensity (Brief Pain Inventory) was reported as mild by 22.3% of patients, moderate by 34.7%, and severe by 43.0%. For each pain intensity category, patient's report of average percent pain relief and health state (EuroQOL 5 Dimensions) was inversely related to average pain intensity category, whereas measures of pain interference, number of worst pain locations, and physical and psychological distress were directly related to pain intensity category. Seventy-seven percent of patients received an opioid at 1 or more clinic encounters. Median daily opioid dose in morphine equivalents was 55 with a range from 2 to 1,145 morphine equivalents. Regression analysis revealed that being male was associated with greater likelihood of an opioid ordered and higher average dosage than being female. The registry can identify patient characteristics and treatments that provide new insights into chronic pain management.

PERSPECTIVE

This article describes results of analyses of patient-reported outcomes and patient-related electronic health record data collected under standard of care from a prospective cohort of chronic pain outpatients at a New York City pain management clinic. The registry provides an opportunity to learn how to improve individualized chronic pain management.

A Scoping Review of Clinical Practice Improvement Methodology Use in Rehabilitation

Context

The Clinical Practice Improvement (CPI) approach is a methodological and quality improvement approach that has emerged and is gaining in popularity. However, there is no systematic description of its use or the determinants of its practice in rehabilitation settings.

Method

We performed a scoping review of the use of CPI methodology in rehabilitation settings.

Results

A total of 103 articles were reviewed. We found evidence of 13 initiatives involving CPI with six different populations. A total of 335 citations of determinants were found, with 68.7% related to CPI itself. Little information was found about what type of external and internal environment, individual characteristics and implementation process might facilitate or hinder the use of CPI.

Conclusion

Given the growing popularity of this methodological approach, CPI initiatives would gain from increasing knowledge of the determinants of its success and incorporating them in future implementation.

The refluxing anterior accessory saphenous vein demonstrates similar clinical severity when compared to the refluxing great saphenous vein

OBJECTIVE

To prospectively compare disease severity in subjects with anterior accessory saphenous vein versus great saphenous vein incompetence with an incompetent saphenofemoral junction.

METHODS

Data were^ collected from 241 subjects and 290 limbs over a six-month period. These subjects were categorized into three groups with primary venous reflux disease, namely anterior accessory saphenous vein, great saphenous vein, and control. Statistical methods including descriptive statistics, student t-tests, and log linear modeling were employed to compare groups and determine predictive features out of the 41 demographic and disease-specific variables collected.

RESULTS

Subjects in the anterior accessory saphenous vein group and those in the great saphenous vein group demonstrate statistically significant differences as compared to the control group with respect to the following disease-specific features: mean VCSS, presence of C2 and C3 disease. The anterior accessory saphenous vein group also showed statistically significant differences in gender compared to both great saphenous vein and control, as well as mean body mass index compared to the control. Log-linear modeling revealed equivalent disease severity when comparing patients with saphenofemoral junction reflux to the great saphenous vein or anterior accessory saphenous vein.

CONCLUSIONS

Patterns of reflux from the saphenofemoral junction to either the anterior accessory saphenous vein or great saphenous vein possess similar disease severity and commonly suffer complications of venous stasis.

Occupational, Physical, and Speech Therapy Treatment Activities During Inpatient Rehabilitation for Traumatic Brain Injury

OBJECTIVE

To describe the use of occupational therapy (OT), physical therapy (PT), and speech therapy (ST) treatment activities throughout the acute rehabilitation stay of patients with traumatic brain injury.

DESIGN

Multisite prospective observational cohort study.

SETTING

Inpatient rehabilitation settings.

PARTICIPANTS

Patients (N=2130) admitted for initial acute rehabilitation after traumatic brain injury. Patients were categorized on the basis of admission FIM cognitive scores, resulting in 5 fairly homogeneous cognitive groups.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Percentage of patients engaged in specific activities and mean time patients engaged in these activities for each 10-hour block of time for OT, PT, and ST combined.

RESULTS

Therapy activities in OT, PT, and ST across all 5 cognitive groups had a primary focus on basic activities. Although advanced activities occurred in each discipline and within each cognitive group, these advanced activities occurred with fewer patients and usually only toward the end of the rehabilitation stay.

CONCLUSIONS

The pattern of activities engaged in was both similar to and different from patterns seen in previous practice-based evidence studies with different rehabilitation diagnostic groups.

Variation in Rehabilitation Treatment Patterns for Hip Fracture Treated With Arthroplasty

BACKGROUND

Recommendations for health care redesign often advocate for comparative effectiveness research that is patient-centered. For patients who require rehabilitation services, a first step in this research process is to understand current practices for specific patient groups.

OBJECTIVE

To document in detail the physical and occupational therapy treatment activities for inpatient hip fracture rehabilitation among 3 patient subgroups distinguished by their early rate of functional recovery between time of surgery to rehabilitation admission.

DESIGN

Multicenter prospective observational cohort, practice-based evidence, study.

SETTING

Seven skilled nursing facilities and 11 inpatient rehabilitation facilities across the United States.

PARTICIPANTS

A total of 226 patients with hip fractures treated with hip arthroplasty.

METHODS

Comparisons of physical and occupational therapy treatment activities among 3 groups with different initial recovery trajectory (IRT) rates (slower, moderate, faster).

MAIN OUTCOME MEASURE(S)

Percent of patients in each IRT group exposed to each physical and occupational therapy activity (exposure), and mean minutes per week for each activity (intensity).

RESULTS

The number of patients exposed to different physical or occupational therapy activities varied within the entire sample. More specifically, among the 3 IRT groups, significant differences in exposure occurred for 44% of physical therapy activities and 39% of occupational therapy activities. More patients in the slower recovery group, IRT 1, received basic activities of daily living treatments and more patients in the faster recovery group, IRT 3, received advanced activities. The moderate recovery group, IRT 2, had some treatments similar to IRT 1 group and others similar to IRT 3 group.

CONCLUSIONS

Analyses of practice-based evidence on inpatient rehabilitation of hip fracture patients treated with arthroplasty identified differences in therapy activities among three patient groups classified by IRT rates. These results may enhance physiatrists', other physicians', and rehabilitation teams' understanding of inpatient rehabilitation for these patients and help design future comparative effectiveness research.

Patterns in Wheeled Mobility Skills Training, Equipment Evaluation, and Utilization: Findings from the SCIRehab Project

Patients with traumatic spinal cord injury (SCI) participate in manual and power wheelchair (WC) skills training during inpatient rehabilitation; wheeled mobility evaluations aim to optimize use, fit, and function of equipment following discharge. Occupational and physical therapists documented treatment sessions during inpatient rehabilitation to describe types and quantity of WC skills training and adaptive equipment (AE) provided by neurological level of injury. Most patients participated in WC skills training; variation in type and frequency exists. Propulsion/driving skills were practiced most frequently. A majority of patients participated in equipment evaluations; assessment/prescription and fitting were performed frequently; mat evaluations were done infrequently. Most patients received mobility equipment in a timely manner; they continued to use their WC and were satisfied with its fit and function at the one-year injury anniversary. High levels of respondent satisfaction with fit and function of WCs suggest clinicians are prescribing mobility devices adequately and accurately supplementing information obtained during equipment assessment and fitting sessions with information from general treatment sessions. Variation in type and frequency of WC training provided by level of SCI and in types of WC prescribed use provides a foundation for future research to relate treatment modalities with functional and participation outcomes.

A comparative effectiveness analysis of treatment for latent tuberculosis infection using multilevel selection models

AIM

Nine months of isoniazid (9INH) is the gold standard for treatment of latent tuberculosis infection (LTBI). This paper compares the effectiveness of 9 months of isoniazid with 4 months of transitional rifampin (9H4R) to alternative therapies, including 9INH, 6 months of isoniazid (6INH) and 6 months of isoniazid with 4 months of transitional rifampin (6H4R), for treatment of LTBI.

MATERIALS & METHODS

Using an ethnically diverse clinic sample of 552 patients given treatment for LTBI with 9H4R, we use multilevel selection models to examine the adjusted comparative effectiveness of the regimens among ethnic groups that feature distinct genetic predispositions to side effects on INH. For unadjusted/absolute effectiveness, we simulated cost-effectiveness ratios for 4 months of rifampin (4RIF) and compared with bootstrapped confidence intervals for the alternative therapies.

RESULTS

There are variations in the comparative effectiveness across ethnic groups, with the most notable differences for 9H4R. For unadjusted/absolute effectiveness, 4RIF presents the greatest net benefit for US born black and African patients. For all other ethnic groups, 6H4R was the most effective.

CONCLUSION

Patient ethnicity affects tolerance to INH. 9H4R was the most effective LTBI treatment for all ethnicities. However, this result heavily depends on whether adjustments are made for self-selection.

Prediction of responders for outcome measures of locomotor Experience Applied Post Stroke trial

The Locomotor Experience Applied Post Stroke rehabilitation trial found equivalent walking outcomes for body weight-supported treadmill plus overground walking practice versus home-based exercise that did not emphasize walking. From this large database, we examined several clinically important questions that provide insights into recovery of walking that may affect future trial designs. Using logistic regression analyses, we examined predictors of response based on a variety of walking speed-related outcomes and measures that captured disability, physical impairment, and quality of life. The most robust predictor was being closer at baseline to the primary outcome measure, which was the functional walking speed thresholds of 0.4 m/s (household walking) and 0.8 m/s (community walking). Regardless of baseline walking speed, a younger age and higher Berg Balance Scale score were relative predictors of responding, whether operationally defined by transitioning beyond each speed boundary or by a continuous change or a greater than median increase in walking speed. Of note, the cutoff values of 0.4 and 0.8 m/s had no particular significance compared with other walking speed changes despite their general use as descriptors of functional levels of walking. No evidence was found for any difference in predictors based on treatment group.

Building a framework for implementing new interventions

Implementation into real-world practice of interventions previously studied in randomized controlled trials is an ongoing challenge. In this article, we describe the methodology we used for the first phase of a project for the implementation and outcomes assessment of an occupational therapy pressure ulcer prevention intervention for people with spinal cord injury in the Veterans Health Administration. This first phase of the project was guided by practice-based evidence research methodology and resulted in an intervention manual tailored to meet the needs of Veterans and the establishment of a system for documenting and monitoring care processes, patient characteristics, and intervention outcomes. This system, in turn, will provide the data-gathering template for the next phase in which the beneficial effects of the intervention will be assessed. We conclude by recommending that clinicians explore the utility of this approach for the implementation of other novel interventions.

Wearable motion sensors to continuously measure real-world physical activities

PURPOSE OF REVIEW

Rehabilitation for sensorimotor impairments aims to improve daily activities, walking, exercise, and motor skills. Monitoring of practice and measuring outcomes, however, is usually restricted to laboratory-based procedures and self-reports. Mobile health devices may reverse these confounders of daily care and research trials.

RECENT FINDINGS

Wearable, wireless motion sensor data, analyzed by activity pattern-recognition algorithms, can describe the type, quantity, and quality of mobility-related activities in the community. Data transmission from the sensors to a cell phone and the Internet enable continuous monitoring. Remote access to laboratory quality data about walking speed, duration and distance, gait asymmetry and smoothness of movements, as well as cycling, exercise, and skills practice, opens new opportunities to engage patients in progressive, personalized therapies with feedback about the performance. Clinical trial designs will be able to include remote verification of the integrity of complex physical interventions and compliance with practice, as well as capture repeated, ecologically sound, ratio scale outcome measures.

SUMMARY

Given the progressively falling cost of miniaturized wearable gyroscopes, accelerometers, and other physiologic sensors, as well as inexpensive data transmission, sensing systems may become as ubiquitous as cell phones for healthcare. Neurorehabilitation can develop these mobile health platforms for daily care and clinical trials to improve exercise and fitness, skills learning, and physical functioning.

Role of practice-based research networks in comparative effectiveness research

Comparative effectiveness research fundamentally reorients how clinical evidence is generated and used with the goal of providing actionable information to decision-makers. To achieve this, it is vital that decision-makers and the research enterprise are engaged from research inception, to evidence generation and translation. Practice-based research networks are affiliated clinicians in diverse communities with the goal of conducting research to improve care. Practice-based research networks have the potential to advance all phases of the comparative effectiveness research cycle. The aim of this paper is to explore current and potential roles of practice-based research networks in conducting comparative effectiveness research.

Using a population-based observational cohort study to address difficult comparative effectiveness research questions: the CEASAR study

BACKGROUND

While randomized controlled trials represent the highest level of evidence we can generate in comparative effectiveness research, there are clinical scenarios where this type of study design is not feasible. The Comparative Effectiveness Analyses of Surgery and Radiation in localized prostate cancer (CEASAR) study is an observational study designed to compare the effectiveness and harms of different treatments for localized prostate cancer, a clinical scenario in which randomized controlled trials have been difficult to execute and, when completed, have been difficult to generalize to the population at large.

METHODS

CEASAR employs a population-based, prospective cohort study design, using tumor registries as cohort inception tools. The primary outcome is quality of life after treatment, measured by validated instruments. Risk adjustment is facilitated by capture of traditional and nontraditional confounders before treatment and by propensity score analysis.

RESULTS

We have accrued a diverse, representative cohort of 3691 men in the USA with clinically localized prostate cancer. Half of the men invited to participate enrolled, and 86% of patients who enrolled have completed the 6-month survey.

CONCLUSION

Challenging comparative effectiveness research questions can be addressed using well-designed observational studies. The CEASAR study provides an opportunity to determine what treatments work best, for which patients, and in whose hands.

The United States' response to the World Report on Disability

The 2011 Annual Disability Status Report notes a disability prevalence rate of 12.1% in the United States. People with disabilities of all ages are increasing in prevalence, and the prevalence increases with age. People with disabilities are high users of health care, have less social participation, and have a higher risk for poverty. Although the United States has a robust history of policy and legislation related to disability and rehabilitation, the ratification of the United Nations Conventions on the Rights of People with Disabilities recently failed in the United States Congress. However, in general, the United States is positioned fairly well regarding most aspects of rehabilitation including a strong rehabilitation science providing a sound base for evidence-based practice. Three key areas of further development emerge: education about disability and benefits of rehabilitation to decision makers and administrators who are concerned with the implementation of the Affordable Care Act, advocacy for a more robust organized presence and acknowledgement of rehabilitation science and research, and advocacy for education about disability and rehabilitation for physicians-in-training.

Evaluating methodological assumptions in comparative effectiveness research: overcoming pitfalls

The scope of comparative effectiveness research (CER) is wide and therefore requires the application of complex statistical tools and nonstandard procedures. The commonly used methods presuppose the realization of important, and often untestable, assumptions pertaining to the underlying distribution, study heterogeneity and targeted population. Accordingly, the value of the results obtained based on such tools is in large part dependent on the validity of the underlying assumptions relating to the operating characteristics of the procedures. In this article, we elucidate some of the pitfalls that may arise with use of the most commonly used techniques, including those that are applied in network meta-analysis, observational data analysis and patient-reported outcome evaluation. In addition, reference is made to the impact of data quality and database heterogeneity on the performance of commonly used CER tools and the need for standards in order to inform researchers engaged in CER.

A systematic review of the literature on the evaluation of handoff tools: implications for research and practice

OBJECTIVE

Given the complexities of the healthcare environment, efforts to develop standardized handoff practices have led to widely varying manifestations of handoff tools. A systematic review of the literature on handoff evaluation studies was performed to investigate the nature, methodological, and theoretical foundations underlying the evaluation of handoff tools and their adequacy and appropriateness in achieving standardization goals.

METHOD

We searched multiple databases for articles evaluating handoff tools published between 1 February 1983 and 15 June 2012. The selected articles were categorized along the following dimensions: handoff tool characteristics, standardization initiatives, methodological framework, and theoretical perspectives underlying the evaluation.

RESULTS

Thirty-six articles met our inclusion criteria. Handoff evaluations were conducted primarily on electronic tools (64%), with a more recent focus on electronic medical record-integrated tools (36% since 2008). Most evaluations centered on intra-departmental tools (95%). Evaluation studies were quasi-experimental (42%) or observational (50%), with a major focus on handoff-related outcome measures (94%) using predominantly survey-based tools (70%) with user satisfaction metrics (53%). Most of the studies (81%) based their evaluation on aspects of standardization that included continuity of care and patient safety.

CONCLUSIONS

The nature, methodological, and theoretical foundations of handoff tool evaluations varied significantly in terms of their quality and rigor, thereby limiting their ability to inform strategic standardization initiatives. Future research should utilize rigorous, multi-method qualitative and quantitative approaches that capture the contextual nuances of handoffs, and evaluate their effect on patient-related outcomes.

Recommendations for the use of operational electronic health record data in comparative effectiveness research

There is an increasing amount of clinical data in operational electronic health record (EHR) systems. Such data provide substantial opportunities for their re-use for many purposes, including comparative effectiveness research (CER). In a previous paper, we identified a number of caveats related to the use of such data, noting that they may be inaccurate, incomplete, transformed in ways that undermine their meaning, unrecoverable for research, of unknown provenance, of insufficient granularity, or incompatible with research protocols. In this paper, we provide recommendations for overcoming these caveats with the goal of leveraging such data to benefit CER and other health care activities. These recommendations include adaptation of "best evidence" approaches to use of data; processes to evaluate availability, completeness, quality, and transformability of data; creation of tools to manage data and their attributes; determination of metrics for assessing whether data are "research grade"; development of methods for comparative validation of data; construction of a methodology database for methods involving use of clinical data; standardized reporting methods for data and their attributes; appropriate use of informatics expertise; and a research agenda to determine biases inherent in operational data and to assess informatics approaches to their improvement.

Rehabilitation of children with traumatic brain injury: a critical review

The purpose of this critical review of the English literature published between 1975 and 2009 was to assess the quality of the evidence for the efficacy of rehabilitation intervention after traumatic brain injury in children. "Evidence for intervention studies" was used to classify the research strength of design and report. Only a minority (16/439) of the published studies has been related to traumatic brain injury in children and has used a scientific or quasiscientific design. Only one study met the criteria of class I "evidence for intervention" studies. However, this study included adults, as well as children. The other 15 studies, although reporting positive results, had many methodologic deficiencies, and consequently their validity is questionable. Although the methodologic and ethical difficulties involved are acknowleged, a multicenter approach is required to achieve valid conclusions. Use of designs such as comparative effectiveness research might prove to be a practical solution. High-quality intervention research would facilitate stronger evidence-based counseling for children and families requiring posttraumatic brain injury intervention and to policy makers.

Reengineering acute episodic and chronic care delivery: the Geisinger Health System experience

Comparative effectiveness research (CER) represents an evolution in clinical decision-making research that allows for the study of heterogeneous groups of patients with complex diseases processes. It has foundations in decision science, reliability science, and health care policy research. Health care finance will increasingly rely on CER for guidance in the coming years. There is increasing awareness of the importance of decreasing unwarranted variation in health care delivery. In the past 7 years, Geisinger Health System has performed broad reengineering of its acute episodic and chronic care delivery models utilizing macrosystem-level application of CER principles. These provider-driven process initiatives have resulted in significant improvement across all segments of care delivery, improved patient outcomes, and notable cost containment. These programs have led to the creation of novel pricing models, and when "hardwired" throughout a care delivery system, they can lead to correct medical decision making by 100% of providers in all patient encounters. Neurosurgery as a specialty faces unique challenges and opportunities with respect to broad adoption and application of CER techniques.

Association of various comorbidity measures with spinal cord injury rehabilitation outcomes

OBJECTIVE

To investigate the amount of variation in short- and medium-term spinal cord injury (SCI) rehabilitation outcomes explained by various comorbidity measures, over and above patient preinjury characteristics and neurologic and functional status.

DESIGN

Prospective observational cohort study of traumatic SCI patients receiving inpatient rehabilitation and followed up at 1 year postinjury.

SETTING

Inpatient rehabilitation and community follow-up at 6 SCI treatment centers.

PARTICIPANTS

Participants (N=1376) included 1032 patients randomly selected for model development and 344 patients selected for cross-validation.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Rehabilitation length of stay (LOS), return to acute care during rehabilitation, discharge motor FIM, discharge home, rehospitalization after discharge, 1-year return to work/school and 1-year depression symptomatology, motor FIM, and residence. Comorbidity measures used were case-mix groups tier weights, Charlson Comorbidity Index (CCI), and the Comprehensive Severity Index (CSI).

RESULTS

Multivariable regression analyses, controlling for patient preinjury and injury characteristics, found that the maximum Comprehensive Severity Index (MCSI) was a significant and stronger predictor of LOS, return to acute care during rehabilitation, and 1-year motor FIM compared with the case-mix groups tier weight or the CCI. The admission CSI was a strong predictor of LOS. For rehospitalization after discharge, only the case-mix groups tier weight was significant. No comorbidity measure was significant beyond patient preinjury and injury characteristics for discharge home, discharge motor FIM, living at home, depression symptomatology, major depressive syndrome, and return to work/school.

CONCLUSIONS

Patient preinjury and injury characteristics are sufficient to predict most SCI outcomes. For rehabilitation LOS and return to acute care during rehabilitation, one achieves substantially better explanation when taking clinical comorbidity based on the MCSI into account.

Group therapy utilization in inpatient spinal cord injury rehabilitation

OBJECTIVE

To describe group therapy utilization in spinal cord injury (SCI) inpatient rehabilitation.

DESIGN

Prospective observational study.

SETTING

Six inpatient rehabilitation facilities.

PARTICIPANTS

Patients (N=1376) receiving initial rehabilitation after traumatic SCI.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

Time spent in group versus individual therapy for physical therapy (PT), occupational therapy (OT), therapeutic recreation (TR), and psychology (PSY) therapies.

RESULTS

The majority (98%) of patients participated in at least 1 group therapy session, with 83%, 81%, 80%, and 54% of patients receiving group PT, OT, TR, and PSY, respectively. On average, 24% of treatment sessions and 27% of treatment time was provided in group sessions, with TR providing the greatest percent of its time in groups. Group therapy time and time spent in specific activities varied among patient subgroups with different injury characteristics. Group therapy time also varied widely among centers (range, 1.2-6.6h/wk). Across all injury subgroups, individual and group therapy hours per week were negatively correlated for OT and positively correlated for TR. Patient characteristics, clinician experience, and treatment center predicted 32% of variance in group hours per week. PT and OT strengthening/endurance interventions and TR outings were the most common group activities overall.

CONCLUSIONS

While the majority of inpatient SCI rehabilitation consists of individual sessions, most patients participate in group therapy, which contributes significantly to total therapy time. Patterns of group utilization fit with functional expectations and clinical goals. A trade-off between group and individual therapy may occur in some disciplines. Utilization of group therapy varies widely among centers, and further study is needed to identify optimal patterns of group therapy utilization.

Chronic venous disorder registry: A new perspective

Chronic venous disorder is one of the most prevalent medical conditions in the US that carries significant economic and health burden. The knowledge into venous pathophysiology, how it develops, and the true quality of life benefits of various treatment options are largely unknown. A truly meaningful clinical data capture system specifically for venous disorder may provide answers to the paucity of data. We describe a modern system to capture research and best practice data using the state of art information technology.

Participation after multidisciplinary rehabilitation for moderate to severe traumatic brain injury in adults: a systematic review

OBJECTIVE

To determine the effectiveness and comparative effectiveness of multidisciplinary rehabilitation programs for moderate to severe traumatic brain injury (TBI) in improving participation-related outcomes in adults. This article presents results of select key questions from a recent Agency for Healthcare Quality and Research comparative effectiveness review.

DATA SOURCES

MEDLINE, Cochrane Central Register of Controlled Trials, and PsycINFO; hand searches of previous relevant reviews.

STUDY SELECTION

We included prospective controlled studies that evaluated the effectiveness or comparative effectiveness of multidisciplinary rehabilitation programs delivered to adults with moderate to severe TBI on their participation in life and community.

DATA EXTRACTION

We extracted data, assessed risk of bias, and evaluated strength of evidence. Participation was selected as our primary outcome and included measures of productivity (eg, return to employment or military service) and select scales measuring community integration. Only data from studies with a low or moderate risk of bias were synthesized.

DATA SYNTHESIS

Twelve studies met our inclusion criteria; of these, 8 were of low or moderate risk of bias (4 randomized controlled trials of 680 patients and 4 cohort studies of 190 patients, sample size 36-366). Heterogeneous populations, interventions, and outcomes precluded pooled analysis. Evidence was insufficient to draw conclusions about effectiveness. Evidence on comparative effectiveness often demonstrated that improvements were not different between groups; however, this evidence was low strength and may have limited generalizability.

CONCLUSIONS

Our review used a rigorous systematic review methodology and focused on participation after multidisciplinary rehabilitation programs for impairments from moderate to severe TBI. The available evidence did not demonstrate the superiority of one approach over another. This conclusion is consistent with previous reviews that examined other patient-centered outcomes. While these findings will have little clinical impact, they do point out the limited evidence available to assess effectiveness and comparative effectiveness while highlighting important issues to consider in future comparative effectiveness research on this topic.