Are Individual Differences in Response to Intervention Influenced by the Methods and Measures Used to Define Response? Implications for Identifying Children With Learning Disabilities

Response to intervention (RTI) has been promoted for nearly 20 years as a valid supplement to or alternative method of learning disability (LD) identification. Nevertheless, important unresolved questions remain about its role in disability identification. We had two purposes when conducting this study of 229 economically and racially diverse poor readers in Grades 4 and 5 in 28 public elementary and middle schools in Nashville. First, we examined predictors of the children's response to a reading comprehension tutoring program. Second, we explored the utility of different methods (growth vs final status) and measures (near- and mid-transfer vs far-transfer) in operationalizing "response," and whether these contrasting methods and measures identified similar children. Findings indicated students with higher pretreatment scores on expressive vocabulary, nonverbal IQ, teacher ratings of attention, and reading comprehension measures were more likely classified as responsive with final status methods. Students with lower pretreatment comprehension scores were more likely identified as responsive with growth methods. These and other findings suggest "response" is strongly context dependent, raising questions about the validity of RTI as a means of disability identification.

Development, implementation and user experience of the Veterans Health Administration (VHA) dialysis dashboard

BACKGROUND

Adults with end-stage renal disease (ESRD) requiring chronic dialysis continue to suffer from poor health outcomes and represent a population rightfully targeted for quality improvement. Electronic dashboards are increasingly used in healthcare to facilitate quality measurement and improvement. However, detailed descriptions of the creation of healthcare dashboards are uncommonly available and formal inquiry into perceptions, satisfaction, and utility by clinical users has been rarely conducted, particularly in the context of dialysis care. Therefore, we characterized the development, implementation and user experience with Veterans Health Administration (VHA) dialysis dashboard.

METHODS

A clinical-quality dialysis dashboard was implemented, which displays clinical performance measures (CPMs) for Veterans with ESRD receiving chronic hemodialysis at all VHA facilities. Data on user experience and perceptions were collected via an e-mail questionnaire to dialysis medical directors and nurse managers at these facilities.

RESULTS

Since 2016 the dialysis dashboard reports monthly on CPMs for approximately 3000 Veterans receiving chronic hemodialysis across 70 VHA dialysis facilities. Of 141 dialysis medical directors and nurse managers, 61 completed the questionnaire. Sixty-six percent of respondents did not find the dashboard difficult to access, 64% agreed that it is easy to use, 59% agreed that its layout is good, and the majority agreed that presentation of data is clear (54%), accurate (56%), and up-to-date (54%). Forty-eight percent of respondents indicated that it helped them improve patient care while 12% did not. Respondents indicated that they used the dialysis dashboard for clinical reporting (71%), quality assessment/performance improvement (QAPI) (62%), and decision-making (23%).

CONCLUSIONS

Most users of the VHA dialysis dashboard found it accurate, up-to-date, easy to use, and helpful in improving patient care. It meets diverse user needs, including administrative reporting, clinical benchmarking and decision-making, and quality assurance and performance improvement (QAPI) activities. Moreover, the VHA dialysis dashboard affords national-, regional- and facility-level assessments of quality of care, guides and motivates best clinical practices, targets QAPI efforts, and informs and promotes population health management improvement efforts for Veterans receiving chronic hemodialysis.

The Inclusion of Economic Endpoints as Outcomes in Clinical Trials Reported to ClinicalTrials.gov

BACKGROUND

As medication expenditures rise, payers are increasingly demanding evidence of economic value for new medications. The 2015 Professional Society for Health Economics and Outcomes Research (ISPOR) Task Force on Cost-Effectiveness Analysis Alongside Clinical Trials noted that clinical trials are increasingly including health care utilization endpoints to address this rising interest in economic information.

OBJECTIVES

To (a) describe the prevalence of economic endpoints in clinical trials submitted to ClinicalTrials.gov and (b) examine associations between trial characteristics and the inclusion of economic endpoints.

METHODS

This retrospective review of ClinicalTrials.gov data extracted the characteristics of clinical trials that were submitted to ClinicalTrials.gov from January 2004 to December 2018; studied a drug and/or biological; and had a recruitment status of not yet recruiting, recruiting, active but not recruiting, or completed. Studies were classified as containing an economic endpoint based on 2 independent evaluations of the inclusion of endpoints relevant to costs, resource utilization, cost-effectiveness, productivity, absenteeism, presenteeism, or unemployment. Descriptive statistics were used to summarize trial characteristics, and chi-square analyses were used to evaluate differences in characteristics between trials with and without economic endpoints.

RESULTS

Of the 104,885 trials included in the study, 1,437 (1.37%) included an economic endpoint; among later phase (phase 2/3, 3, 4) trials, 939 (2.54%) included economic endpoints. Compared with studies that did not include economic endpoints, those that did were less often industry funded (48.0% vs. 52.0%, P < 0.001) and were for a high-spend specialty condition (24.1% vs. 27.4%, P < 0.001). The proportion of trials that included economic endpoints increased by a small but significant amount over the time period studied, from 1.2% (2004-2008) to 1.6% (2014-2018; P < 0.001).

CONCLUSIONS

A small but growing number of clinical trials are including economic endpoints. This finding may reflect continued industry concerns surrounding the cost and logistical challenges of piggybacking economic data collection alongside clinical trials and/or manufacturers' preferences for modeling for value demonstration. Future research is needed to better understand barriers to the inclusion of economic endpoints as well as the degree to which incorporating health care resource utilization collected during clinical trials into early economic modeling may reduce payer concerns about model transparency and bias.

DISCLOSURES

No outside funding supported this study. Patterson reports past employment by Indivior, unrelated to this study. Mitchell has nothing to disclose. The research included in this study was presented as a nonreviewed student pharmacist poster at AMCP Nexus 2019; October 30-November 1, 2019; National Harbor, MD.

Criteria and Process for Initiating and Developing an ISPOR Good Practices Task Force Report

The International Society for Pharmacoeconomics and Outcomes Research (ISPOR)'s "Good Practices Task Force" reports are highly cited, multistakeholder perspective expert guidance reports that reflect international standards for health economics and outcomes research (HEOR) and their use in healthcare decision making. In this report, we discuss the criteria, development, and evaluation/consensus review and approval process for initiating a task force. The rationale for a task force must include a justification, including why this good practice guidance is important and its potential impact on the scientific community. The criteria include: (1) necessity (why is this task force required?); (2) a methodology-oriented focus (focus on research methods, approaches, analysis, interpretation, and dissemination); (3) relevance (to ISPOR's mission and its members); (4) durability over time; (5) broad applicability; and 6) an evidence-based approach. In addition, the proposal must be a priority specifically for ISPOR. These reports are valuable to researchers, academics, students, health technology assessors, medical technology developers and service providers, those working in other commercial entities, regulators, and payers. These stakeholder perspectives are represented in task force membership to ensure the report's overall usefulness and relevance to the global ISPOR membership. We hope that this discussion will bring transparency to the process of initiating, approving, and producing these task force reports and encourage participation from a diverse range of experts within and outside ISPOR.

Health Utility Weighting of the Modified Rankin Scale: A Systematic Review and Meta-analysis

IMPORTANCE

The utility-weighted modified Rankin Scale (UW-mRS) has been proposed as a patient-centered alternative primary outcome for stroke clinical trials. However, to date, there is no clear consensus on an approach to weighting the mRS.

OBJECTIVE

To characterize the between-study variability in utility weighting of the mRS in a population of patients who experienced stroke and its implications when applied to the results of a clinical trial.

DATA SOURCES

In this systematic review and meta-analysis, MEDLINE, Embase, and PsycINFO were searched from January 1987 through May 2019 using major search terms for stroke, health utility, and mRS.

STUDY SELECTION

Original research articles published in English were reviewed. Included were studies with participants 18 years or older with ischemic or hemorrhagic stroke, transient ischemic attack, or subarachnoid hemorrhage, with mRS scores and utility weights evaluated concurrently. A total of 5725 unique articles were identified. Of these, 283 met criteria for full-text review, and 24 were included in the meta-analysis.

DATA EXTRACTION AND SYNTHESIS

PRISMA guidelines for systematic review were followed. Data extraction was performed independently by multiple researchers. Data were pooled using mixed models.

MAIN OUTCOMES AND MEASURES

The mean utility weights and 95% CIs were calculated for each mRS score and health utility scale. Geographic differences in weighting for the EuroQoL 5-dimension (EQ-5D) and Stroke Impact Scale-based UW-mRS were explored using inverse variance-weighted linear models. The results of 18 major acute stroke trials cited in current guidelines were then reanalyzed using the UW-mRS weighting scales identified in the systematic review.

RESULTS

The meta-analysis included 22 389 individuals; the mean (SD) age of participants was 65.9 (4.0) years, and the mean (SD) proportion of male participants was 58.2% (7.5%). For all health utility scales evaluated, statistically significant differences were observed between the mean utility weights by mRS score. For studies using an EQ-5D-weighted mRS, between-study variance was higher for worse (mRS 2-5) compared with better (mRS 0-1) scores. Of the 18 major acute stroke trials with reanalyzed results, 3 had an unstable outcome when using different UW-mRSs.

CONCLUSIONS AND RELEVANCE

Multiple factors, including cohort-specific characteristics and health utility scale selection, can influence mRS utility weighting. If the UW-mRS is selected as a primary outcome, the approach to weighting may alter the results of a clinical trial. Researchers using the UW-mRS should prospectively and concurrently obtain mRS scores and utility weights to characterize study-specific outcomes.

SLEEP-GOAL: A multicenter success criteria outcome study on 302 obstructive sleep apnoea (OSA) patients

OBJECTIVE

To demonstrate SLEEP-GOAL as a more holistic and comprehensive success criterion for Obstructive Sleep Apnoea (OSA) treatment.

METHODS

A prospective 7-country clinical trial of 302 OSA patients, who met the selection criteria, and underwent nose, palate and/or tongue surgery. Pre- and post-operative data were recorded and analysed based on both the Sher criteria (apnoea hypopnea index, AHI reduction 50% and <20) and the SLEEP-GOAL.

RESULTS

There were 229 males and 73 females, mean age of 42.4±17.3 years, mean BMI 27.9±4.2. The mean VAS score improved from 7.7±1.4 to 2.5±1.7 (p<0.05), mean Epworth score (ESS) improved from 12.2±4.6 to 4.9±2.8 (p<0.05), mean body mass index (BMI) decreased from 27.9±4.2 to 26.1±3.7 (p>0.05), gross weight decreased from 81.9±14.3kg to 76.6±13.3kg. The mean AHI decreased 33.4±18.9 to 14.6±11.0 (p<0.05), mean lowest oxygen saturation (LSAT) improved 79.4±9.2% to 86.9±5.9% (p<0.05), and mean duration of oxygen <90% decreased from 32.6±8.9 minutes to 7.3±2.1 minutes (p<0.05). The overall success rate (302 patients) based on the Sher criteria was 66.2%. Crosstabulation of respective major/minor criteria fulfilment, based on fulfilment of two major and two minor or better, the success rate (based on SLEEP-GOAL) was 69.8%. Based solely on the Sher criteria, 63 patients who had significant blood pressure reduction, 29 patients who had BMI reduction and 66 patients who had clinically significant decrease in duration of oxygen <90% would have been misclassified as "failures".

CONCLUSION

AHI as a single parameter is unreliable. Assessing true success outcomes of OSA treatment, requires comprehensive and holistic parameters, reflecting true end-organ injury/function; the SLEEP-GOAL meets these requirements.

Testicular cancer: improving outcomes with national quality performance indicators

Testicular cancer is the most common malignancy in young adult men. The prognosis is excellent in limited disease and cure is possible even in advanced disease. Quality performance indicators (QPI) are used in many developed countries as a measure of healthcare performance. We report and discuss the development of a national set of QPIs in Scotland for testicular cancer as a method of gathering demographic data and driving improvement in nationwide testicular cancer outcomes.

Student perceptions of the utility of the Pharmacy Curriculum Outcomes Assessment

INTRODUCTION

This study assessed student perceptions, preparation, and result use strategies of the Pharmacy Curriculum Outcomes Assessment (PCOA). Secondarily, it studied the effect of schools/colleges of pharmacy (S/COP) PCOA management on student perceptions.

METHODS

A 52-item electronic questionnaire assessed PCOA preparation of final year students, review/use of results, remediation participation, self-reported motivation, and perceptions of the exam's ability to measure PCOA blueprint areas and North American Pharmacy Licensure Examination (NAPLEX)/advanced pharmacy practice experience (APPE) readiness. Programs were given a questionnaire to determine their PCOA practices.

RESULTS

The student survey was completed by 341 students (40% response rate). Students prepared very little for the PCOA and few reported participation in PCOA-based remediation (6%). Students perceived the PCOA to measure the four domains moderately well, although administrative sciences were significantly lower. Students reported less confidence in the exam's ability to measure APPE/NAPLEX-readiness. Although few used the PCOA to guide their NAPLEX preparation (18%), they were more likely to do so than for APPEs (4%). Students reported a higher perceived increase in motivation if PCOA results were connected to APPE placement, remediation, and progression as opposed to prizes, rewards, or other recognitions.

CONCLUSION

This is the first multi-institutional study to review student perceptions about the PCOA. These data can be used along with other PCOA data to help schools develop incentive, remediation, and examination administration procedures depending on the programs desired use for the PCOA exam.

Exploring the applicability of the pregnancy and childbirth outcome set: A mixed methods study

OBJECTIVE

The International Consortium for Health Outcomes Measurement developed the Pregnancy and Childbirth (PCB) outcome set to improve value-based perinatal care. This set contains clinician-reported outcomes and patient-reported outcomes. We validated the set for use in the Netherlands by exploring its applicability among all end-users prior to implementation.

METHODS

A mixed-methods design was applied. A survey was performed to assess patients (n = 142), professionals (n = 134) and administrators (n = 35) views on the PCB set. To further explore applicability, separate focus groups were held with representatives of each of these groups.

RESULTS

The majority of survey participants agreed that the PCB set contains the most important outcomes. Patient-reported experience measures were considered relevant by the majority of participants. Perceived relevance of patient-reported outcome measures varied. Main themes from the focus groups were content of the set, data collection timing, implementation (also IT and transparency), and quality-based governance.

CONCLUSION

This study supports suitability of the PCB outcome set for implementation, evaluation of quality of care and shared decision making in perinatal care.

PRACTICE IMPLICATIONS

Implementation of the PCB set may change existing care pathways of perinatal care. Focus on transparency of outcomes is required in order to achieve quality-based governance with proper IT solutions.

Scalp ripples as prognostic biomarkers of epileptogenicity in pediatric surgery

Objective

To assess the ability of high‐density Electroencephalography (HD‐EEG) and magnetoencephalography (MEG) to localize interictal ripples, distinguish between ripples co‐occurring with spikes (ripples‐on‐spike) and independent from spikes (ripples‐alone), and evaluate their localizing value as biomarkers of epileptogenicity in children with medically refractory epilepsy.

Methods

We retrospectively studied 20 children who underwent epilepsy surgery. We identified ripples on HD‐EEG and MEG data, localized their generators, and compared them with intracranial EEG (icEEG) ripples. When ripples and spikes co‐occurred, we performed source imaging distinctly on the data above 80 Hz (to localize ripples) and below 70 Hz (to localize spikes). We assessed whether missed resection of ripple sources predicted poor outcome, separately for ripples‐on‐spikes and ripples‐alone. Similarly, predictive value of spikes was calculated.

Results

We observed scalp ripples in 16 patients (10 good outcome). Ripple sources were highly concordant to the icEEG ripples (HD‐EEG concordance: 79%; MEG: 83%). When ripples and spikes co‐occurred, their sources were spatially distinct in 83‐84% of the cases. Removing the sources of ripples‐on‐spikes predicted good outcome with 90% accuracy for HD‐EEG (P = 0.008) and 86% for MEG (P = 0.044). Conversely, removing ripples‐alone did not predict outcome. Resection of spike sources (generated at the same time as ripples) predicted good outcome for HD‐EEG (P = 0.036; accuracy = 87%), while did not reach significance for MEG (P = 0.1; accuracy = 80%).

Interpretation

HD‐EEG and MEG localize interictal ripples with high precision in children with refractory epilepsy. Scalp ripples‐on‐spikes are prognostic, noninvasive biomarkers of epileptogenicity, since removing their cortical generators predicts good outcome. Conversely, scalp ripples‐alone are most likely generated by non‐epileptogenic areas.

Value of thrombus imaging in predicting the outcomes of patients with large-vessel occlusive strokes after endovascular therapy

BACKGROUND

Acute ischemic stroke leads to serious long-term disability and high mortality, especially in patients with large-vessel occlusive strokes. Nowadays, endovascular therapy is considered as an alternative treatment for these patients. Several studies have used thrombus characteristics based on non-contrast computed tomography (NCCT) and computed tomography angiography (CTA) to predict prognosis in ischemic stroke. We conducted a systematic review to identify potential imaging predictive factors for successful recanalization and improved clinical outcome after endovascular therapy in patients with large-vessel occlusion (LVO) in anterior arterial circulation.

METHODS

The PubMed databases were searched for related studies reported between September 18, 2009, and September 18, 2019.

RESULTS

We selected 11 studies on revascularization and 12 studies on clinical outcome. Patients with thrombus of higher Hounsfield unit (HU), shorter length, higher clot burden score, and increased thrombus permeability may achieve higher recanalization and improved clinical outcome, but the matter is still under debate.

CONCLUSION

Imaging of thrombus can be used as an aseessment tool to predict the outcomes and it needs further studies in the future.

Outcome choice and definition in systematic reviews leads to few eligible studies included in meta-analyses: a case study

BACKGROUND

There is broad recognition of the importance of evidence in informing clinical decisions. When information from all studies included in a systematic review ("review") does not contribute to a meta-analysis, decision-makers can be frustrated. Our objectives were to use the field of eyes and vision as a case study and examine the extent to which authors of Cochrane reviews conducted meta-analyses for their review's pre-specified main outcome domain and the reasons that some otherwise eligible studies were not incorporated into meta-analyses.

METHODS

We examined all completed systematic reviews published by Cochrane Eyes and Vision, as of August 11, 2017. We extracted information about each review's outcomes and, using an algorithm, categorized one outcome as its "main" outcome. We calculated the percentage of included studies incorporated into meta-analyses for any outcome and for the main outcome. We examined reasons for non-inclusion of studies into the meta-analysis for the main outcome.

RESULTS

We identified 175 completed reviews, of which 125 reviews included two or more studies. Across these 125 reviews, the median proportions of studies incorporated into at least one meta-analysis for any outcome and for the main outcome were 74% (interquartile range [IQR] 0-100%) and 28% (IQR 0-71%), respectively. Fifty-one reviews (41%) could not conduct a meta-analysis for the main outcome, mostly because fewer than two included studies measured the outcome (21/51 reviews) or the specific measurements for the outcome were inconsistent (16/51 reviews).

CONCLUSIONS

Outcome choice during systematic reviews can lead to few eligible studies included in meta-analyses. Core outcome sets and improved reporting of outcomes can help solve some of these problems.

Key Population Health Outcomes for Children with Medical Complexity: A Systematic Review

INTRODUCTION

Despite the significant healthcare policy and program implications, a summary measure of health for children with medical complexity (CMC) has not been identified. It is unclear whether existing population health approaches apply to CMC. We conducted a systematic review of the existing peer-reviewed research literature on CMC to describe the health outcomes currently measured for CMC.

METHODS

We searched MEDLINE and PsycINFO by linking combinations of key words from three groups of concepts: (1) pediatric, (2) medical complexity, and (3) chronicity or severity. Study eligibility criteria were research studies including CMC with any outcome reported. Data on the outcomes were systematically extracted. Iterative content analysis organized outcomes into conceptual domains and sub-domains.

RESULTS

Our search yielded 3853 articles. After exclusion criteria were applied, 517 articles remained for data extraction. Five distinct outcome domains and twenty-four sub-domains emerged. Specifically, 50% of the articles studied healthcare access and use; 43% family well-being; 39% child health and well-being; 38% healthcare quality; and 25% adaptive functioning. Notably lacking were articles examining routine child health promotion as well as child mental health and outcomes related to family functioning.

CONCLUSIONS

Key health domains for CMC exist. Adaptations of existing sets of metrics and additional tools are needed to fully represent and measure population health for CMC. This approach may guide policies and programs to improve care for CMC.

Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline

In systematic reviews that lack data amenable to meta-analysis, alternative synthesis methods are commonly used, but these methods are rarely reported. This lack of transparency in the methods can cast doubt on the validity of the review findings. The Synthesis Without Meta-analysis (SWiM) guideline has been developed to guide clear reporting in reviews of interventions in which alternative synthesis methods to meta-analysis of effect estimates are used. This article describes the development of the SWiM guideline for the synthesis of quantitative data of intervention effects and presents the nine SWiM reporting items with accompanying explanations and examples.

Lower Extremity Functional Outcome Measures in Duchenne Muscular Dystrophy-A Delphi Survey

BACKGROUND

Duchenne muscular dystrophy (DMD) is a progressive neuromuscular disease characterized by progressive muscle weakness, multiple system involvement and premature mortality. Effective treatments for DMD through clinical trials and natural history studies are currently underway. Clinical trials in DMD typically include several outcome measures of motor function. Research sites and studies have been found to have slightly different operational definitions for a given functional outcome resulting in different procedures and protocols for these measurements.

OBJECTIVE

The goal of this study is to establish agreement among experts in the field around best practices in collecting functional outcome data in DMD providing researchers and clinicians with guidance on best practices.

METHODS

A group of 30 experts in Duchenne Muscular Dystrophy (DMD) with experience in the development and/ or execution of lower extremity outcome measures for this population met face to face to identify incongruences in the collection of this data. This effort was based in the United States (US) and sponsored by Parent Project Muscular Dystrophy. Several discrepancies were categorized for each outcome which included: 6-minute walk test, 10-meter walk/run, supine to stand, ascend 4 stairs, sit to stand, and the NorthStar Ambulatory Assessment. Following this meeting an additional 32 experts in DMD (28 from the United States and 11 international participants) consented to participate in a Delphi Survey to reach consensus on the protocols and execution of lower extremity outcomes.

RESULTS

Round one: 70 operationally defined questions were surveyed with 45 (64%) reaching >70% consensus. Round two: 27 questions were operational, with 20 (74%) reaching >70% consensus. Those questions that did not reach consensus appear minor.

CONCLUSION

With minor modifications in the collection of data across sites, outcomes could potentially be normalized across research studies. This would reduce excessive training for evaluators in trials and produce minimal differences between protocols. Consistency in protocols will promote more efficient study start up, less errors between administration of items across studies, and ultimately improve quality and reliability of the functional outcomes. The authors strongly advocate for the establishment of a "research network library" that could be utilized by all those performing clinical assessments and trials in DMD.

Development and validation of psoriatic arthritis switch quality assessment tool (PASQAL) - an outcomes measurement tool to assess the quality of biologic switch decisions in psoriatic arthritis

BACKGROUND

Switching between biologic therapies is a recommended strategy for Psoriatic Arthritis (PsA) patients that show an insufficient response or adverse events. Although the choice of the subsequent biologic may be dependent on many factors, assessing the quality of the switch decision is of utmost relevance.

OBJECTIVES

To develop and validate two outcomes measurement tools (for patients with peripheral and axial PsA phenotypes) that address the quality of treatment decisions in PsA regarding the switch of biologic therapies in clinical practice.

METHODS

A Task Force and an Expert Panel were specifically assembled for this purpose. The Psoriatic Arthritis Switch Quality Assessment tool (PASQAL) development comprised a modified-Delphi method in a four-step procedure: 1) literature search and experts' opinion collection about quality indicators for PsA management; 2) Delphi design to address the development of the measurement tool; 3) three Delphi questionnaire rounds; 4) final consensus meeting. This phase resulted in the definition of two measurement tools, one to evaluate the quality of biologic switch in peripheral (pPASQAL) and another one in axial PsA (axPASQAL). For the validation of PASQAL, 12 experienced rheumatologists were asked to evaluate and classify the biologic switch of 80 clinical cases (40 with predominant peripheral and 40 with predominant axial PsA). Clinical judgement was defined to be the "gold standard" against which the performance of PASQAL was assessed. The results were used to assess tools' performance (sensitivity/specificity analysis) and the agreement between the tools and the gold standard (Cohen's kappa).

RESULTS

PASQAL consists of 6 domains (joint disease activity, dactylitis, enthesis, physical function, quality of life, and skin and nail manifestations), respective instruments and thresholds. The classification of the biologic switch was divided into three quality levels: "Good", based on treat-to-target thresholds; "Moderate", based on improvement from baseline; and the remaining as "Insufficient". pPASQAL was found to be highly sensitive (92%) with the "Good" quality level and specific (97%) with the "Insufficient" quality level. Whilst axPASQAL showed overall higher sensitivity and specificity for all quality levels, as well as a higher level of agreement between the tool and the gold standard than pPASQAL (k=0.87 vs k=0.71).

CONCLUSION

PASQAL was developed and showed good criterion validity for the evaluation of the quality of switch in both peripheral and axial PsA phenotypes. These tools may be used in research as well as in clinical practice, to support rheumatologists in making more informed therapeutic decisions.

Is It Possible to Conduct a Multi-Arm Multi-Stage Platform Trial in Parkinson's Disease: Lessons Learned from Other Neurodegenerative Disorders and Cancer

Many potential disease modifying therapies have been identified as suitable for clinical evaluation in Parkinson's disease (PD). Currently, the evaluation of compounds in phase II and phase III clinical trials in PD are set up in isolation, a process that is lengthy, costly and lacks efficiency. This review will introduce the concept of a multi-arm, multi-stage (MAMS) trial platform which allows for the assessment of several potential therapies at once, transitioning seamlessly from a phase II safety and efficacy study to a phase III trial by means of an interim analysis. At the interim checkpoint, ineffective arms are dropped and replaced by new treatment arms, thereby allowing for the continuous evaluation of interventions. MAMS trial platforms already exist for prostate, renal and oropharyngeal cancer and are currently being developed for progressive multiple sclerosis (PMS) and motor neuron disease (MND) within the UK. As a MAMS trial will evaluate many potential treatments it is of critical importance that a widely endorsed core protocol is developed which will investigate outcomes and objectives meaningful to patients. This review will discuss the challenges of drug selection, trial design, stratification and outcome measures and will share strategies implemented in the planned MAMS trials for MND and PMS that may be of interest to the PD field.

Modified Outpatient Physical Therapy Improvement in Movement Assessment Log (mOPTIMAL): A Responsive and Reliable Tool for Patients with Non-Operative Shoulder Pain

BACKGROUND

Medicare regulations require that physical therapists report functional limitations and severity modifiers utilizing a claims-based data collection tool. The Modified Outpatient Physical Therapy Improvement in Movement Assessment Log (mOPTIMAL) captures key constructs about patient confidence and difficulty but has not been evaluated for responsiveness/ reliability during a routine clinical encounter with patients who have shoulder pathology. The purposes of this retrospective study are to 1) explore if mOPTIMAL changes after a single session with a physical therapist, and 2) determine if the tool is reliable among people with non-operative shoulder pain.

METHODS

We included 106 individuals (58% female; mean age 45.8; range: 18-94 yrs.) with "non-operative" shoulder pathology who were seen in outpatient physical therapy from 2011 to 2012. Subjects completed a mOPTIMAL survey and a pain scale before and immediately after the initial physical therapy visit. The mOPTIMAL is a patient-centered instrument that assesses how much "Difficulty" and "Confidence" a client has in performing a battery of functional tasks. T-tests, Cronbach's Alpha, and Intra-class Correlations were used to assess responsiveness, internal consistency, and reliability, respectively.

RESULTS

After a single visit, participants reported improved Confidence with sleeping, dressing/ bathing, throwing, carrying, and lifting (adjusted for ceiling effects; p<0.002) but no change in pain. Cronbach's Alpha and Intra-class Correlations were excellent (0.821-0.923; 0.967, respectively).

CONCLUSIONS

mOPTIMAL is a reliable and responsive tool with excellent internal consistency. This observational study revealed that patient Confidence may change independent of Pain after a single physical therapy visit. Taken together, the mOPTIMAL appears to be an excellent tool to report severity modifiers in compliance with Medicare regulations.Level of Evidence: IV.

Cross-cultural adaptation and psychometric properties of the Chinese version of the Functional Remission of General Schizophrenia (FROGS) scale and the four-item version (mini-FROGS) among people with schizophrenia

OBJECTIVE

This study was designed to verify the cross-cultural psychometric properties of the Functional Remission of General Schizophrenia (FROGS) scale and the four-item version (mini-FROGS) in Chinese schizophrenic individuals.

METHODS

Item clustering analysis was used to show the clustering relationship among items. Confirmatory factor analysis (CFA) was used to test the structural validity of the scale. The Global Assessment of Functioning (GAF) was used as a criterion to test convergent validity. The receiver operating characteristic curve (ROC) and the area under the ROC curve (ROC-AUC) were calculated to test the sensitivity and specificity of FROGS and mini-FROGS for functional assessment. Fifty participants were randomly selected for retest at two-month intervals.

RESULTS

A total of 228 schizophrenia individuals were enrolled in our study. The results of the item clustering analysis and CFA supported the 3-factor structure of the original scale, and all items, except for the item "absence of antisocial or violent", showed good psychometric characteristics. The correlated coefficients between FROGS and mini-FROGS with the GAF were excellent (FROGS: r = 0.74, p＜0.01; mini-FROGS: r = 0.65, p＜0.01). The retest showed that the scale had good stability and validity over time (ICC = 0.856; 95% CI = 0.701∼0.941). Both mini-FROGS and FROGS had good sensitivity and specificity for the measurement of social function (mini-FROGS: ROC-AUC = 84.3% (76.9%-91.6%), and FROGS: ROC-AUC = 89.2% (83.0%-95.4%)), and there was no difference between the two versions of ROC-AUC (P = 0.154).

CONCLUSION

The results of our study showed that the Chinese version of FROGS and mini-FROGS had good psychometric properties for assessing the social function of people with schizophrenia in China. In particular, the mini-FROGS version was better used in the clinical setting because of its convenience and efficiency.

Step-down units are cost-effective alternatives to coronary care units with non-inferior outcomes in the management of ST-elevation myocardial infarction patients after successful primary percutaneous coronary intervention

Percutaneous coronary interventions (PCIs) within a door-to-balloon timing of 90 min have greatly decreased mortality and morbidity of ST-elevation myocardial infarction (STEMI) patients. Post-PCI, they are routinely transferred into the coronary care unit (CCU) regardless of the severity of their condition, resulting in frequent CCU overcrowding. This study assesses the feasibility of step-down units (SDUs) as an alternative to CCUs in the management of STEMI patients after successful PCI, to alleviate CCU overcrowding. Criteria of assessment include in-hospital complications, length of stay, cost-effectiveness, and patient outcomes up to a year after discharge from hospital. A retrospective case-control study was done using data of 294 adult STEMI patients admitted to the emergency departments of two training and research hospitals and successfully underwent primary PCI from 1 January 2014 to 31 December 2015. Patients were followed up for a year post-discharge. Student t test and χ² test were done as univariate analysis to check for statistical significance of p < 0.05. Further regression analysis was done with respect to primary outcomes to adjust for major confounders. Patients managed in the SDU incurred significantly lower inpatient costs (p = 0.0003). No significant differences were found between the CCU and SDU patients in terms of patient characteristics, PCI characteristics, in-hospital complications, length of stay, and patient outcomes up to a year after discharge. The SDU is a viable cost-effective option for managing STEMI patients after successful primary PCI to avoid CCU overcrowding, with non-inferior patient outcomes as compared to the CCU.

Development of Common Data Elements for Use in Chiari Malformation Type I Clinical Research: An NIH/NINDS Project

The management of Chiari I malformation (CMI) is controversial because treatment methods vary and treatment decisions rest on incomplete understanding of its complex symptom patterns, etiologies, and natural history. Validity of studies that attempt to compare treatment of CMI has been limited because of variable terminology and methods used to describe study subjects. The goal of this project was to standardize terminology and methods by developing a comprehensive set of Common Data Elements (CDEs), data definitions, case report forms (CRFs), and outcome measure recommendations for use in CMI clinical research, as part of the CDE project at the National Institute of Neurological Disorders and Stroke (NINDS) of the US National Institutes of Health. A working group, comprising over 30 experts, developed and identified CDEs, template CRFs, data dictionaries, and guidelines to aid investigators starting and conducting CMI clinical research studies. The recommendations were compiled, internally reviewed, and posted online for external public comment. In October 2016, version 1.0 of the CMI CDE recommendations became available on the NINDS CDE website. The recommendations span these domains: Core Demographics/Epidemiology; Presentation/Symptoms; Co-Morbidities/Genetics; Imaging; Treatment; and Outcome. Widespread use of CDEs could facilitate CMI clinical research trial design, data sharing, retrospective analyses, and consistent data sharing between CMI investigators around the world. Updating of CDEs will be necessary to keep them relevant and applicable to evolving research goals for understanding CMI and its treatment.

The Fonthill Dental Surgery Complication Classification Scale

Objectives

A lack of consensus on how to classify post-operative complications in dentistry limits the ability for comparison of outcomes among treatments and their primary providers. Therefore, the Fonthill Dental Surgery Complication Classification Scale has been proposed as a uniform reporting tool to allow for the standardized quality assessment of dental treatment. This instrument classifies negative outcomes arising after dental treatment and is based on the clinician and the clinician time required to resolve the complication in seven classes of increasing severity.

Materials and Methods

The scale was evaluated in a cohort of 2,382 consecutive patients, of which 9% experienced a complication, the majority of which were Class I or Class II-resolved without intervention by the dental surgeon.

Results

Four scenarios where interpretation of the scale was required are presented with an explanation of their complication class.

Conclusions

This classification system will ultimately prove reliable in measuring clinician success rate and aiding in the decision-making process for patients, clinicians, and financial providers.

Validation of the COPD Assessment Test (CAT) as an Outcome Measure in Bronchiectasis

BACKGROUND

Objective assessment of symptoms in bronchiectasis is important for research and in clinical practice. The COPD Assessment Test (CAT) is a short, simple assessment tool widely used in COPD. The items included in the CAT are not specific to COPD and also reflect the dominant symptoms of bronchiectasis. We therefore performed a study to validate the CAT as an outcome measure in bronchiectasis.

METHODS

The CAT was administered to two cohorts of bronchiectasis patients along with other quality of life questionnaires. Patients underwent comprehensive clinical assessment. One cohort had repeated questionnaires collected before-and-after treatment of acute exacerbations. We analyzed convergent validity, repeatability, and responsiveness of the score and calculated the minimum clinically important difference (MCID) using a combination of distribution and anchor-based methods.

RESULTS

In both cohorts there were positive correlations between the CAT and the St. George's Respiratory Questionnaire (r = 0.90, P < .0001 and r = 0.87, P < .0001). There was an inverse relationship between CAT and Quality of Life - Bronchiectasis Respiratory Symptoms Scale (r = -0.75, P < .0001) and Leicester Cough Questionnaire score (r = -0.77, P < .0001). Patients with more severe disease, based on the bronchiectasis severity index, had significantly higher CAT scores. CAT also correlated with FEV₁ % predicted and 6-min walk distance (6MWD). CAT increased significantly at exacerbation and fell at recovery. The intraclass correlation coefficient for two measurements four-weeks apart while clinically stable was 0.88 (95% CI, 0.73-0.95, P < .0001). An MCID of 4 was most consistent.

CONCLUSIONS

CAT is a valid, responsive symptom assessment tool in bronchiectasis. The MCID is estimated as 4 points.