1
|
Brieva-Toloza AV, Hovmand OR, Micali N, Christensen AB. Let's get aligned! Developing a core outcome set for clinical trials in eating disorders. EUROPEAN EATING DISORDERS REVIEW 2024; 32:652-661. [PMID: 38389169 DOI: 10.1002/erv.3079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 01/30/2024] [Accepted: 02/03/2024] [Indexed: 02/24/2024]
Abstract
OBJECTIVE Our study aimed to review the outcome measures/assessment instruments used and to assess their heterogeneity/homogeneity in eating disorders (EDs) randomised controlled trials. METHODS APA PsycInfo, PubMed, and Embase were searched in December 2022 to identify studies published between and inclusive of January 2012 and December 2022. Inclusion/exclusion criteria were: (1) complete articles published in peer-reviewed scientific journals, which were: (2) randomised trials, (3) in a clinical setting (4) with human subjects, (5) with an ICD or DSM diagnosis of Anorexia Nervosa, Binge Eating Disorder, or Bulimia Nervosa. The selected papers also: (6) used one or more standardised instruments designed to measure one or more psychometric characteristics associated with ED as a primary or secondary outcome, as judged by the authors of this systematic review, and (7) were published in English or Danish. RESULTS Ninety one articles were included, and a total of 196 outcome measures were collected. DISCUSSION The diversity of outcome measures in ED trials hampers result comparability and data integration. We suggest creating a core outcome measure set using the Delphi method, including clinician and patient-reported ED assessments, along with relevant comorbidity scales.
Collapse
|
2
|
Ludolph AC, Corcia P, Desnuelle C, Heiman-Patterson T, Mora JS, Mansfield CD, Couratier P. Categorization of the amyotrophic lateral sclerosis population via the clinical determinant of post-onset ΔFS for study design and medical practice. Muscle Nerve 2024; 70:36-41. [PMID: 38712849 DOI: 10.1002/mus.28101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 04/16/2024] [Accepted: 04/21/2024] [Indexed: 05/08/2024]
Abstract
The amyotrophic lateral sclerosis (ALS) functional rating scale-revised (ALSFRS-R) has become the most widely utilized measure of disease severity in patients with ALS, with change in ALSFRS-R from baseline being a trusted primary outcome measure in ALS clinical trials. This is despite the scale having several established limitations, and although alternative scales have been proposed, it is unlikely that these will displace ALSFRS-R in the foreseeable future. Here, we discuss the merits of delta FS (ΔFS), the slope or rate of ALSFRS-R decline over time, as a relevant tool for innovative ALS study design, with an as yet untapped potential for optimization of drug effectiveness and patient management. In our view, categorization of the ALS population via the clinical determinant of post-onset ΔFS is an important study design consideration. It serves not only as a critical stratification factor and basis for patient enrichment but also as a tool to explore differences in treatment response across the overall population; thereby, facilitating identification of responder subgroups. Moreover, because post-onset ΔFS is derived from information routinely collected as part of standard patient care and monitoring, it provides a suitable patient selection tool for treating physicians. Overall, post-onset ΔFS is a very attractive enrichment tool that is, can and should be regularly incorporated into ALS trial design.
Collapse
|
3
|
Sampat V, Whitinger J, Flynn-O'Brien K, Kim I, Balakrishnan B, Mehta N, Sawdy R, Patel ND, Nallamothu R, Zhang L, Yan K, Zvara K, Farias-Moeller R. Accuracy of Early Neuroprognostication in Pediatric Severe Traumatic Brain Injury. Pediatr Neurol 2024; 155:36-43. [PMID: 38581727 DOI: 10.1016/j.pediatrneurol.2024.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 02/15/2024] [Accepted: 03/12/2024] [Indexed: 04/08/2024]
Abstract
BACKGROUND Children with severe traumatic brain injury (sTBI) are at risk for neurological sequelae impacting function. Clinicians are tasked with neuroprognostication to assist in decision-making. We describe a single-center study assessing clinicians' neuroprognostication accuracy. METHODS Clinicians of various specialties caring for children with sTBI were asked to predict their patients' functioning three to six months postinjury. Clinicians were asked to participate in the study if their patient had survived but not returned to baseline between day 4 and 7 postinjury. The outcome tool utilized was the functional status scale (FSS), ranging from 6 to 30 (best-worst function). Predicted scores were compared with actual scores three to six months postinjury. Lin concordance correlation coefficients were used to estimate agreement between predicted and actual FSS. Outcome was dichotomized as good (FSS 6 to 8) or poor (FSS ≥9). Positive and negative predictive values for poor outcome were calculated. Pessimistic prognostic prediction was defined as predicted worse outcome by ≥3 FSS points. Demographic and clinical variables were collected. RESULTS A total of 107 surveys were collected on 24 patients. Two children died. Fifteen children had complete (FSS = 6) or near-complete (FSS = 7) recovery. Mean predicted and actual FSS scores were 10.8 (S.D. 5.6) and 8.6 (S.D. 4.1), respectively. Predicted FSS scores were higher than actual scores (P < 0.001). Eight children had collective pessimistic prognostic prediction. CONCLUSIONS Clinicians predicted worse functional outcomes, despite high percentage of patients with near-normal function at follow-up clinic. Certain patient and provider factors were noted to impact accuracy and need to be studied in larger cohorts.
Collapse
|
4
|
Klockgether T, Synofzik M. Consensus Recommendations for Clinical Outcome Assessments and Registry Development in Ataxias: Ataxia Global Initiative (AGI) Working Group Expert Guidance. CEREBELLUM (LONDON, ENGLAND) 2024; 23:924-930. [PMID: 37020147 PMCID: PMC11102398 DOI: 10.1007/s12311-023-01547-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/13/2023] [Indexed: 04/07/2023]
Abstract
To accelerate and facilitate clinical trials, the Ataxia Global Initiative (AGI) was established as a worldwide research platform for trial readiness in ataxias. One of AGI's major goals is the harmonization and standardization of outcome assessments. Clinical outcome assessments (COAs) that describe or reflect how a patient feels or functions are indispensable for clinical trials, but similarly important for observational studies and in routine patient care. The AGI working group on COAs has defined a set of data including a graded catalog of COAs that are recommended as a standard for future assessment and sharing of clinical data and joint clinical studies. Two datasets were defined: a mandatory dataset (minimal dataset) that can ideally be obtained during a routine clinical consultation and a more demanding extended dataset that is useful for research purposes. In the future, the currently most widely used clinician-reported outcome measure (ClinRO) in ataxia, the scale for the assessment and rating of ataxia (SARA), should be developed into a generally accepted instrument that can be used in upcoming clinical trials. Furthermore, there is an urgent need (i) to obtain more data on ataxia-specific, patient-reported outcome measures (PROs), (ii) to demonstrate and optimize sensitivity to change of many COAs, and (iii) to establish methods and evidence of anchoring change in COAs in patient meaningfulness, e.g., by determining patient-derived minimally meaningful thresholds of change.
Collapse
|
5
|
Zaragoza Domingo S, Alonso J, Ferrer M, Acosta MT, Alphs L, Annas P, Balabanov P, Berger AK, Bishop KI, Butlen-Ducuing F, Dorffner G, Edgar C, de Gracia Blanco M, Harel B, Harrison J, Horan WP, Jaeger J, Kottner J, Pinkham A, Tinoco D, Vance M, Yavorsky C. Methods for Neuroscience Drug Development: Guidance on Standardization of the Process for Defining Clinical Outcome Strategies in Clinical Trials. Eur Neuropsychopharmacol 2024; 83:32-42. [PMID: 38579661 DOI: 10.1016/j.euroneuro.2024.02.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Revised: 02/12/2024] [Accepted: 02/13/2024] [Indexed: 04/07/2024]
Abstract
Neurosciences clinical trials continue to have notoriously high failure rates. Appropriate outcomes selection in early clinical trials is key to maximizing the likelihood of identifying new treatments in psychiatry and neurology. The field lacks good standards for designing outcome strategies, therefore The Outcomes Research Group was formed to develop and promote good practices in outcome selection. This article describes the first published guidance on the standardization of the process for clinical outcomes in neuroscience. A minimal step process is defined starting as early as possible, covering key activities for evidence generation in support of content validity, patient-centricity, validity requirements and considerations for regulatory acceptance. Feedback from expert members is provided, regarding the risks of shortening the process and examples supporting the recommended process are summarized. This methodology is now available to researchers in industry, academia or clinics aiming to implement consensus-based standard practices for clinical outcome selection, contributing to maximizing the efficiency of clinical research.
Collapse
|
6
|
Driscoll A, Clayden S, Lowe G. Call for the development and use of nurse practitioner sensitive outcome measures. Eur J Cardiovasc Nurs 2024; 23:e37-e38. [PMID: 38306407 DOI: 10.1093/eurjcn/zvae008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Accepted: 01/19/2024] [Indexed: 02/04/2024]
|
7
|
Walker HGM, Brown AJ, Vaz IP, Reed R, Schofield MA, Shao J, Nanjayya VB, Udy AA, Jeffcote T. Composite outcome measures in high-impact critical care randomised controlled trials: a systematic review. Crit Care 2024; 28:184. [PMID: 38807143 PMCID: PMC11134769 DOI: 10.1186/s13054-024-04967-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Accepted: 05/22/2024] [Indexed: 05/30/2024] Open
Abstract
BACKGROUND The use of composite outcome measures (COM) in clinical trials is increasing. Whilst their use is associated with benefits, several limitations have been highlighted and there is limited literature exploring their use within critical care. The primary aim of this study was to evaluate the use of COM in high-impact critical care trials, and compare study parameters (including sample size, statistical significance, and consistency of effect estimates) in trials using composite versus non-composite outcomes. METHODS A systematic review of 16 high-impact journals was conducted. Randomised controlled trials published between 2012 and 2022 reporting a patient important outcome and involving critical care patients, were included. RESULTS 8271 trials were screened, and 194 included. 39.1% of all trials used a COM and this increased over time. Of those using a COM, only 52.6% explicitly described the outcome as composite. The median number of components was 2 (IQR 2-3). Trials using a COM recruited fewer participants (409 (198.8-851.5) vs 584 (300-1566, p = 0.004), and their use was not associated with increased rates of statistical significance (19.7% vs 17.8%, p = 0.380). Predicted effect sizes were overestimated in all but 6 trials. For studies using a COM the effect estimates were consistent across all components in 43.4% of trials. 93% of COM included components that were not patient important. CONCLUSIONS COM are increasingly used in critical care trials; however effect estimates are frequently inconsistent across COM components confounding outcome interpretations. The use of COM was associated with smaller sample sizes, and no increased likelihood of statistically significant results. Many of the limitations inherent to the use of COM are relevant to critical care research.
Collapse
|
8
|
Durão S. There is a need to address uptake of core outcome sets in research and guidelines. J Clin Epidemiol 2024; 169:111310. [PMID: 38423400 DOI: 10.1016/j.jclinepi.2024.111310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Accepted: 02/22/2024] [Indexed: 03/02/2024]
|
9
|
Lane M, Miao T, Turgeon RD. Clinician's Approach to Advanced Statistical Methods: Win Ratios, Restricted Mean Survival Time, Responder Analyses, and Standardized Mean Differences. J Gen Intern Med 2024; 39:1196-1203. [PMID: 38172409 PMCID: PMC11116328 DOI: 10.1007/s11606-023-08582-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 12/14/2023] [Indexed: 01/05/2024]
Abstract
Novel statistical methods have emerged in recent medical literature, which clinicians must understand to properly appraise and integrate evidence into their practice. Some of these key concepts include win ratios, restricted mean survival time, responder analyses, and standardized mean difference. This article offers guidance to busy clinicians on the comprehension and practical applicability of the results to patients. Win ratios provide an alternative method to analyze composite outcomes by prioritizing individual components of the composite; prioritization of the outcomes should be evidence-based, pre-specified, and patient-centered. Restricted mean survival time presents a method to analyze Kaplan-Meier curves when assumptions required for Cox proportional hazards analysis are not met. As it only considers outcomes that occur within a specific timeframe, the duration of follow-up must be appropriately defined and based on prior epidemiologic and mechanistic evidence. Researchers can analyze continuous outcomes with responder analyses, in which participants are dichotomized into "responders" or "non-responders." While clinicians and patients may more easily grasp outcomes analyzed in this way, they should be aware of the loss of information and resulting imprecision, as well as potential to manipulate data presentation. When meta-analyzing continuous outcomes, point estimates can be converted to standardized mean differences to facilitate the combination of data utilizing various outcome measures. However, clinicians may find it challenging to grasp the clinical meaningfulness of a standardized mean difference, and may benefit from converting it to well-known outcomes. By providing the background knowledge of these statistical methods, along with practical applicability, benefits, and inevitable limitations, this article aims to provide clinicians with an approach to appraise the literature and apply the results in clinical practice.
Collapse
|
10
|
Kottner J, Beaton D, Clarke M, Dodd S, Kirkham J, Lange T, Nieuwlaat R, Schmitt J, Tugwell P, Williamson P. Core outcome set developers should consider and specify the level of granularity of outcome domains. J Clin Epidemiol 2024; 169:111307. [PMID: 38428539 DOI: 10.1016/j.jclinepi.2024.111307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 02/20/2024] [Accepted: 02/21/2024] [Indexed: 03/03/2024]
|
11
|
Lehman R, Moriarty H. Limited English Proficiency and Outcomes in the Intensive Care Unit: An Integrated Review. J Transcult Nurs 2024; 35:226-236. [PMID: 38351583 DOI: 10.1177/10436596241229485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2024] Open
Abstract
INTRODUCTION Language barriers place patients at risk of substandard care. Hospitalized patients with limited English proficiency (LEP) face unique challenges, especially in the intensive care unit (ICU). The purpose of this review is to critique and synthesize quantitative evidence on LEP and ICU outcomes. METHODOLOGY Quantitative studies published in English between 1999 and 2022 were queried using intentional terminology. RESULTS Searches yielded 138 results, with 12 meeting inclusion criteria. The analysis resulted in the extrapolation of five themes pertinent to outcomes of ICU patients or families with LEP: (a) knowledge deficit relating to conditions and care; (b) lack of language-appropriate care; (c) alienation from care process; (d) decreased confidence and ownership of care; and (e) relationship to clinical quality indicators. DISCUSSION Outcomes associated with LEP were largely negative and revealed unmet needs for ICU patients with LEP. More research is needed to improve linguistically and culturally congruent care in the ICU.
Collapse
|
12
|
Rhodes S, Dodd S, Deckert S, Vasanthan L, Qiu R, Rohde JF, Florez ID, Schmitt J, Nieuwlaat R, Kirkham J, Williamson PR. Representation of published core outcome sets in practice guidelines. J Clin Epidemiol 2024; 169:111311. [PMID: 38423401 DOI: 10.1016/j.jclinepi.2024.111311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 12/14/2023] [Accepted: 02/22/2024] [Indexed: 03/02/2024]
Abstract
OBJECTIVES A core outcome set (COS) is an agreed standardized set of outcomes that should be measured and reported, as a minimum, in specific areas of health or health care. A COS is developed through a consensus process to ensure health care outcomes to be measured are relevant to decision-makers, including patients and health-care professionals. Use of COS in guideline development is likely to increase the relevance of the guideline to those decision-makers. Previous work has looked at the uptake of COS in trials, systematic reviews, health technology assessments and regulatory guidance but to date there has been no evaluation of the use of COS in practice guideline development. The objective of this study was to investigate the representation of core outcomes in a set of international practice guidelines. STUDY DESIGN AND SETTING We searched for clinical guidelines relevant to ten high-quality COS (with focus on the United Kingdom, Germany, China, India, Canada, Denmark, United States and World Health Organisation). We matched scope between COS and guideline in terms of condition, population and outcome. We calculated the proportion of guidelines mentioning or referencing COS and the proportion of COS domains specifically, or generally, matching to outcomes specified in each guideline populations, interventions, comparators and outcome (PICO) statement. RESULTS We found 38 guidelines that contained 170 PICO statements matching the scope of the ten COS and of sufficient quality to allow data extraction. None of the guidelines reviewed explicitly mentioned or referenced the relevant COS. The median (range) of the proportion of core outcomes covered either specifically or generally by the guideline PICO was 30% (0%-100%). CONCLUSION There is no evidence that COS are being used routinely to inform the guideline development process, and concordance between outcomes in published guidelines and those in COS is limited. Further work is warranted to explore barriers and facilitators in the use of COS when developing clinical guidelines.
Collapse
|
13
|
Edwards KM, Griffin MR. Postmarketing Vaccine Safety Assessments: Important Work in Progress. JAMA 2024; 331:915-917. [PMID: 38502085 DOI: 10.1001/jama.2023.26630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/20/2024]
|
14
|
Kannan S, Bruch JD, Song Z. Changes in Hospital Adverse Events and Patient Outcomes Associated With Private Equity Acquisition. JAMA 2023; 330:2365-2375. [PMID: 38147093 PMCID: PMC10751598 DOI: 10.1001/jama.2023.23147] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Accepted: 10/22/2023] [Indexed: 12/27/2023]
Abstract
Importance The effects of private equity acquisitions of US hospitals on the clinical quality of inpatient care and patient outcomes remain largely unknown. Objective To examine changes in hospital-acquired adverse events and hospitalization outcomes associated with private equity acquisitions of US hospitals. Design, Setting, and Participants Data from 100% Medicare Part A claims for 662 095 hospitalizations at 51 private equity-acquired hospitals were compared with data for 4 160 720 hospitalizations at 259 matched control hospitals (not acquired by private equity) for hospital stays between 2009 and 2019. An event study, difference-in-differences design was used to assess hospitalizations from 3 years before to 3 years after private equity acquisition using a linear model that was adjusted for patient and hospital attributes. Main Outcomes and Measures Hospital-acquired adverse events (synonymous with hospital-acquired conditions; the individual conditions were defined by the US Centers for Medicare & Medicaid Services as falls, infections, and other adverse events), patient mix, and hospitalization outcomes (including mortality, discharge disposition, length of stay, and readmissions). Results Hospital-acquired adverse events (or conditions) were observed within 10 091 hospitalizations. After private equity acquisition, Medicare beneficiaries admitted to private equity hospitals experienced a 25.4% increase in hospital-acquired conditions compared with those treated at control hospitals (4.6 [95% CI, 2.0-7.2] additional hospital-acquired conditions per 10 000 hospitalizations, P = .004). This increase in hospital-acquired conditions was driven by a 27.3% increase in falls (P = .02) and a 37.7% increase in central line-associated bloodstream infections (P = .04) at private equity hospitals, despite placing 16.2% fewer central lines. Surgical site infections doubled from 10.8 to 21.6 per 10 000 hospitalizations at private equity hospitals despite an 8.1% reduction in surgical volume; meanwhile, such infections decreased at control hospitals, though statistical precision of the between-group comparison was limited by the smaller sample size of surgical hospitalizations. Compared with Medicare beneficiaries treated at control hospitals, those treated at private equity hospitals were modestly younger, less likely to be dually eligible for Medicare and Medicaid, and more often transferred to other acute care hospitals after shorter lengths of stay. In-hospital mortality (n = 162 652 in the population or 3.4% on average) decreased slightly at private equity hospitals compared with the control hospitals; there was no differential change in mortality by 30 days after hospital discharge. Conclusions and Relevance Private equity acquisition was associated with increased hospital-acquired adverse events, including falls and central line-associated bloodstream infections, along with a larger but less statistically precise increase in surgical site infections. Shifts in patient mix toward younger and fewer dually eligible beneficiaries admitted and increased transfers to other hospitals may explain the small decrease in in-hospital mortality at private equity hospitals relative to the control hospitals, which was no longer evident 30 days after discharge. These findings heighten concerns about the implications of private equity on health care delivery.
Collapse
|
15
|
Keng MJ, Leal J, Mafham M, Bowman L, Armitage J, Mihaylova B. Performance of the UK Prospective Diabetes Study Outcomes Model 2 in a Contemporary UK Type 2 Diabetes Trial Cohort. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2022; 25:435-442. [PMID: 35227456 PMCID: PMC8881217 DOI: 10.1016/j.jval.2021.09.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 08/27/2021] [Accepted: 09/06/2021] [Indexed: 06/14/2023]
Abstract
OBJECTIVES The UK Prospective Diabetes Study (UKPDS) Outcomes Model (UKPDS-OM) developed using 30-year (1977-2007) data from the UKPDS is widely used for health outcomes' projections and economic evaluations of therapies for patients with type 2 diabetes (T2D). Nevertheless, its reliability for contemporary UK T2D populations is unclear. We assessed the performance of version 2 of the model (UKPDS-OM2) using data from A Study of Cardiovascular Events in Diabetes (ASCEND), which followed participants with diabetes in the UK between 2005 and 2017. METHODS The UKPDS-OM2 was used to predict the occurrence of myocardial infarction (MI), other ischemic heart disease, stroke, cardiovascular (CV) death, and other death among the 14 569 participants with T2D in ASCEND, all without previous CV disease at study entry. Calibration (comparison of predicted and observed year-on-year cumulative incidence over 10 years) and discrimination (c-statistics) of the model were assessed for each endpoint. The percentage error in event rates at year 7 (mean duration of follow up) was used to quantify model bias. RESULTS The UKPDS-OM2 substantially overpredicted MI, stroke, CV death, and other death over the 10-year follow-up period (by 149%, 42%, 269%, and 52%, respectively, at year 7). Discrimination of the model for MI and other ischemic heart disease (c-statistics 0.58 and 0.60, respectively) was poorer than that for other outcomes (c-statistics ranging from 0.66 to 0.72). CONCLUSIONS The UKPDS-OM2 substantially overpredicted risks of key CV outcomes and death in people with T2D in ASCEND. Appropriate adjustments or a new model may be required for assessments of long-term effects of treatments in contemporary T2D cohorts.
Collapse
|
16
|
Otte WM, Vinkers CH, Habets PC, van IJzendoorn DGP, Tijdink JK. Analysis of 567,758 randomized controlled trials published over 30 years reveals trends in phrases used to discuss results that do not reach statistical significance. PLoS Biol 2022; 20:e3001562. [PMID: 35180228 PMCID: PMC8893613 DOI: 10.1371/journal.pbio.3001562] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 03/03/2022] [Accepted: 01/31/2022] [Indexed: 11/19/2022] Open
Abstract
The power of language to modify the reader's perception of interpreting biomedical results cannot be underestimated. Misreporting and misinterpretation are pressing problems in randomized controlled trials (RCT) output. This may be partially related to the statistical significance paradigm used in clinical trials centered around a P value below 0.05 cutoff. Strict use of this P value may lead to strategies of clinical researchers to describe their clinical results with P values approaching but not reaching the threshold to be "almost significant." The question is how phrases expressing nonsignificant results have been reported in RCTs over the past 30 years. To this end, we conducted a quantitative analysis of English full texts containing 567,758 RCTs recorded in PubMed between 1990 and 2020 (81.5% of all published RCTs in PubMed). We determined the exact presence of 505 predefined phrases denoting results that approach but do not cross the line of formal statistical significance (P < 0.05). We modeled temporal trends in phrase data with Bayesian linear regression. Evidence for temporal change was obtained through Bayes factor (BF) analysis. In a randomly sampled subset, the associated P values were manually extracted. We identified 61,741 phrases in 49,134 RCTs indicating almost significant results (8.65%; 95% confidence interval (CI): 8.58% to 8.73%). The overall prevalence of these phrases remained stable over time, with the most prevalent phrases being "marginally significant" (in 7,735 RCTs), "all but significant" (7,015), "a nonsignificant trend" (3,442), "failed to reach statistical significance" (2,578), and "a strong trend" (1,700). The strongest evidence for an increased temporal prevalence was found for "a numerical trend," "a positive trend," "an increasing trend," and "nominally significant." In contrast, the phrases "all but significant," "approaches statistical significance," "did not quite reach statistical significance," "difference was apparent," "failed to reach statistical significance," and "not quite significant" decreased over time. In a random sampled subset of 29,000 phrases, the manually identified and corresponding 11,926 P values, 68,1% ranged between 0.05 and 0.15 (CI: 67. to 69.0; median 0.06). Our results show that RCT reports regularly contain specific phrases describing marginally nonsignificant results to report P values close to but above the dominant 0.05 cutoff. The fact that the prevalence of the phrases remained stable over time indicates that this practice of broadly interpreting P values close to a predefined threshold remains prevalent. To enhance responsible and transparent interpretation of RCT results, researchers, clinicians, reviewers, and editors may reduce the focus on formal statistical significance thresholds and stimulate reporting of P values with corresponding effect sizes and CIs and focus on the clinical relevance of the statistical difference found in RCTs.
Collapse
|
17
|
Gero D, Muller X, Staiger RD, Gutschow CA, Vonlanthen R, Bueter M, Clavien PA, Puhan MA. How to Establish Benchmarks for Surgical Outcomes?: A Checklist Based on an International Expert Delphi Consensus. Ann Surg 2022; 275:115-120. [PMID: 32398485 DOI: 10.1097/sla.0000000000003931] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To define a standardized methodology for establishing benchmarks for relevant outcomes in surgery. SUMMARY BACKGROUND DATA Benchmarking is an established tool to improve quality in industry and economics, and is emerging in assessing outcome values in surgery. Despite a recent 10-step approach to identify such benchmark values, a standardized and more widely agreed-on approach is still lacking. METHODS A multinational web-based Delphi survey with a focus on methodological requirements for establishing benchmarks for surgical outcomes was performed. Participants were selected among internationally renowned specialists in abdominal, vascular, and thoracic surgery. Consensus was defined as ≥70% agreement and results were used to develop a checklist to establish benchmarks in surgery. RESULTS Forty-one surgical opinion leaders from 19 countries and 5 continents were involved. Experts' response rates were 98% and 80% in rounds 1 and 2, respectively. Upon completion of the final Delphi round, consensus was successfully achieved for 26 of 36 items covering the following areas: center eligibility, validation of databases, patient cohort selection, procedure selection, duration of follow-up, statistical analysis, and publication requirements regarding center-specific outcomes. CONCLUSIONS This multinational Delphi survey represents the first expert-led process for developing a standardized approach for establishing benchmarks for relevant outcome measures in surgery. The provided consensual checklist customizes the methodology of outcome reporting in surgery and thus improves reproducibility and comparability of data and should ultimately serve to improve quality of care.
Collapse
|
18
|
Oversoe SK, Sorensen BS, Tabaksblat EM, Gronbaek H, Kelsen J. Cell-Free DNA and Clinical Characteristics in Patients with Small Intestinal or Pancreatic Neuroendocrine Tumors. Neuroendocrinology 2022; 112:43-50. [PMID: 33461190 DOI: 10.1159/000514457] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 01/15/2021] [Indexed: 11/19/2022]
Abstract
INTRODUCTION Neuroendocrine tumors (NETs) are rare and characterized by a heterogeneous clinical course and an unmet need for better prognostic markers. Plasma cell-free DNA (cfDNA) has prognostic value in other malignancies but is not previously investigated in NETs. We studied cfDNA levels in patients with mainly low-grade small intestinal NET -(siNET) or pancreatic NET (pNET) and evaluated the prognostic potential of cfDNA. MATERIALS AND METHODS We included 70 NET patients, siNET (n = 50) and pNET (n = 20). Plasma cfDNA levels were determined by droplet digital PCR for the beta-2-microglobulin gene every 6 months during a period of 3 years, including in a subgroup of 19 patients during peptide receptor radionuclide therapy (PRRT) therapy. RESULTS cfDNA levels were higher in both siNET and pNET compared to a previously established healthy cohort (p < 0.0001). -cfDNA levels did not predict overall survival (crude hazard ratio [HR] 0.95 [0.57-1.58], p = 0.837, adjusted for smoking status HR 0.77 [0.51-1.17], p = 0.22). The impact of cfDNA level on progression-free survival showed different trends in siNET and pNET. There was no effect of PRRT treatment on cfDNA levels and no difference in cfDNA levels between patients with and without progressive disease after PRRT (ANOVA p = 0.66). cfDNA levels were significantly higher in never-smokers and previous smokers than in current smokers (p = 0.029). DISCUSSION/CONCLUSION cfDNA levels are higher in NET patients than in healthy controls; however, there was no association with prognosis, and cfDNA levels were unaffected by PRRT. Our observations suggest that cfDNA levels are not associated with the disease course in low-grade NET in contrast to other malignancies.
Collapse
|
19
|
Mayer T, Venkatesh A, Berwick DM. Criterion-Based Measurements of Patient Experience in Health Care: Eliminating Winners and Losers to Create a New Moral Ethos. JAMA 2021; 326:2471-2472. [PMID: 34854868 DOI: 10.1001/jama.2021.21771] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
20
|
Street A, Smith P. How can we make valid and useful comparisons of different health care systems? Health Serv Res 2021; 56 Suppl 3:1299-1301. [PMID: 34755335 PMCID: PMC8579199 DOI: 10.1111/1475-6773.13883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 09/18/2021] [Accepted: 09/24/2021] [Indexed: 11/28/2022] Open
|
21
|
Hu S, Luo W, Darzi A, Pan Y, Zhao G, Liu Y, Xiong C. Do racial and ethnic disparities in following stay-at-home orders influence COVID-19 health outcomes? A mediation analysis approach. PLoS One 2021; 16:e0259803. [PMID: 34762685 PMCID: PMC8584966 DOI: 10.1371/journal.pone.0259803] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Accepted: 10/26/2021] [Indexed: 11/20/2022] Open
Abstract
Racial/ethnic disparities are among the top-selective underlying determinants associated with the disproportional impact of the COVID-19 pandemic on human mobility and health outcomes. This study jointly examined county-level racial/ethnic differences in compliance with stay-at-home orders and COVID-19 health outcomes during 2020, leveraging two-year geo-tracking data of mobile devices across ~4.4 million point-of-interests (POIs) in the contiguous United States. Through a set of structural equation modeling, this study quantified how racial/ethnic differences in following stay-at-home orders could mediate COVID-19 health outcomes, controlling for state effects, socioeconomics, demographics, occupation, and partisanship. Results showed that counties with higher Asian populations decreased most in their travel, both in terms of reducing their overall POIs' visiting and increasing their staying home percentage. Moreover, counties with higher White populations experienced the lowest infection rate, while counties with higher African American populations presented the highest case-fatality ratio. Additionally, control variables, particularly partisanship, median household income, percentage of elders, and urbanization, significantly accounted for the county differences in human mobility and COVID-19 health outcomes. Mediation analyses further revealed that human mobility only statistically influenced infection rate but not case-fatality ratio, and such mediation effects varied substantially among racial/ethnic compositions. Last, robustness check of racial gradient at census block group level documented consistent associations but greater magnitude. Taken together, these findings suggest that US residents' responses to COVID-19 are subject to an entrenched and consequential racial/ethnic divide.
Collapse
|
22
|
Alketbi A, Basit S, Hamza N, Walton LM, Moustafa IM. The added value of cognition-targeted exercise versus symptom-targeted exercise for multiple sclerosis fatigue: A randomized controlled pilot trial. PLoS One 2021; 16:e0258752. [PMID: 34748549 PMCID: PMC8575272 DOI: 10.1371/journal.pone.0258752] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 09/20/2021] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Fatigue is considered one of the most common symptoms of multiple sclerosis (MS) and lacks a current standardized treatment. Therefore, the aim of this study was to examine the feasibility and effectiveness of a cognition-targeted exercise versus symptom-targeted exercise for MS fatigue. METHODS In this Pilot, parallel-group, randomized controlled trial, sixty participants with multiple sclerosis, were randomly assigned to either a Cognition-Targeted Exercise (CTE) (N = 30, mean age 41) or a Symptom-Targeted Exercise (STE) (N = 30, mean age 42). The participants in the experimental group received eight, 50-minute sessions of weekly Cognitive Behavior Therapy (CBT) in addition to a CTE Program; whereas, participants in the control group received eight, 50-minute sessions of weekly CBT in addition to the standardized physiotherapy program (STE Program). Feasibility was assessed through recruitment rate, participant retention, adherence and safety, in addition to clinical outcome measures, including: (1) Modified Fatigue Impact Scale (MFIS), (2) Work and Social Adjustment Scale (WSAS), (3) Hospital Anxiety and Depression Scale (HADS), and Perceived Stress Scale (PSS). All outcome measures were assessed at baseline (pretreatment), following completion of the eight visit intervention protocol, and at 3-months follow-up. RESULTS The recruitment rate was 60% and 93% of participants completed the entire study. The recruited participants complied with 98% of the required visits. No adverse events were recorded. A Generalized Estimation Equation Model revealed a significant difference over time as an interaction term during the post and follow up visit for all clinical outcome measures (p < .001). CONCLUSION The addition of CTE to CBT exhibited positive and more lasting influence on MS fatigue outcomes compared to Symptom-Targeted Exercise (STE). Feasibility and efficacy data from this pilot study provide support for a full-scale RCT of CTE as an integral component of Multiple Sclerosis fatigue management.
Collapse
|
23
|
Paixão C, Rebelo P, Oliveira A, Jácome C, Cruz J, Martins V, Simão P, Marques A. Responsiveness and Minimal Clinically Important Difference of the Brief-BESTest in People With COPD After Pulmonary Rehabilitation. Phys Ther 2021; 101:6365141. [PMID: 34499161 DOI: 10.1093/ptj/pzab209] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 05/21/2021] [Accepted: 07/11/2021] [Indexed: 11/12/2022]
Abstract
OBJECTIVE he Brief-Balance Evaluation Systems Test (Brief-BESTest) is a comprehensive, reliable, and valid balance test that provides valuable information to guide balance training in people with chronic obstructive pulmonary disease (COPD). Its clinical interpretability is, however, currently limited, because cutoff points to identify clinically relevant changes in people with COPD after pulmonary rehabilitation are still lacking. This study aimed to establish the responsiveness and minimal clinically important difference (MCID) for the Brief-BESTest in people with COPD after pulmonary rehabilitation (PR). METHODS A secondary analysis of data from 2 previous studies was conducted. The modified British Medical Research Council (mMRC) dyspnea scale, the 6-Minute Walk Test (6-MWT), and the Brief-BESTest (0-24 points) were collected in people with COPD pre/post a 12-week PR program including balance training. The MCID was computed using anchor- and distribution-based methods. Changes in the 6-MWT and the mMRC were assessed and used as anchors. The pooled MCID was computed using the arithmetic weighted mean (2/3 anchor- and 1/3 distribution-based methods). RESULTS Seventy-one people with COPD (69 years [SD = 8]; 76% male; FEV1 = 49.8%predicted [SD = 18%]) were included. There was a significant improvement in the Brief-BESTest after PR (mean difference = 3 points [SD = 3]). Significant correlations were found between the Brief-BESTest and the mMRC (r = -.31) and the 6-MWT (r = .37). The pooled MCID was 3.3 points. CONCLUSION An improvement of at least 3 points in the Brief-BESTest in people with COPD will enhance the interpretability of PR effects on balance performance of this population and guide tailored interventions. IMPACT The Brief-BESTest outcome measure is comprehensive, easily administered, and simple to interpret in clinical practice. This study represents a significant contribution toward the clinical interpretation of changes in balance in people with COPD following PR.
Collapse
|
24
|
Dovell G, Staniszewska A, Ramirez J, Murray I, Ambler GK, Twine CP, Hinchliffe RJ. A systematic review of outcome reporting for interventions to treat people with diabetic foot ulceration. Diabet Med 2021; 38:e14664. [PMID: 34324741 DOI: 10.1111/dme.14664] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Revised: 06/23/2021] [Accepted: 07/27/2021] [Indexed: 12/26/2022]
Abstract
BACKGROUND Diabetic foot ulceration (DFU) is a challenging clinical problem that affects up to a quarter of patients with diabetes in their lifetime. An agreed set of outcomes for assessing treatments or interventions for DFU has not previously been considered. The aim of this study was to identify outcomes that are reported in clinical studies assessing a treatment or intervention for DFU, to inform the development of a core outcome set (COS). METHODS Systematic literature searches were performed between January 2016 and March 2019. The search strategy was pre-registered with PROSPERO (CRD42019128250). Two authors independently screened abstracts for full text review. Outcomes were extracted from selected papers verbatim and categorized into domains according to established taxonomy. Consistency of outcome reporting was assessed. Overlapping outcomes were merged independently to condense the extracted list of outcomes for use in forthcoming consensus processes. RESULTS Of 4645 abstracts identified, 114 studies met the inclusion criteria. There were 69 randomized studies, 40 prospective studies and 5 protocols. Some 948 outcomes were extracted verbatim. Outcome reporting was consistent for 474 (53%) outcomes. De-duplication left 714 unique verbatim outcomes across 33 domains. Merging of overlapping unique verbatim outcomes established 95 merged outcomes. CONCLUSION This study describes contemporary outcomes reported in studies assessing interventions for DFU. Outcome reporting is considered to be poor as it was consistent in just over half of outcomes extracted. Merging of outcomes has identified 95 outcomes that can be taken forward in the development of a COS.
Collapse
|
25
|
Landstra CP, Andres A, Chetboun M, Conte C, Kelly Y, Berney T, de Koning EJP, Piemonti L, Stock PG, Pattou F, Vantyghem MC, Bellin MD, Rickels MR. Examination of the Igls Criteria for Defining Functional Outcomes of β-cell Replacement Therapy: IPITA Symposium Report. J Clin Endocrinol Metab 2021; 106:3049-3059. [PMID: 34061967 PMCID: PMC8571711 DOI: 10.1210/clinem/dgab386] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Indexed: 11/19/2022]
Abstract
CONTEXT The Igls criteria were developed to provide a consensus definition for outcomes of β-cell replacement therapy in the treatment of diabetes during a January 2017 workshop sponsored by the International Pancreas & Islet Transplant Association (IPITA) and the European Pancreas & Islet Transplant Association. In July 2019, a symposium at the 17th IPITA World Congress was held to examine the Igls criteria after 2 years in clinical practice, including validation against continuous glucose monitoring (CGM)-derived glucose targets, and to propose future refinements that would allow for comparison of outcomes with artificial pancreas system approaches. EVIDENCE ACQUISITION Utilization of the criteria in various clinical and research settings was illustrated by population as well as individual outcome data of 4 islet and/or pancreas transplant centers. Validation against CGM metrics was conducted in 55 islet transplant recipients followed-up to 10 years from a fifth center. EVIDENCE SYNTHESIS The Igls criteria provided meaningful clinical assessment on an individual patient and treatment group level, allowing for comparison both within and between different β-cell replacement modalities. Important limitations include the need to account for changes in insulin requirements and C-peptide levels relative to baseline. In islet transplant recipients, CGM glucose time in range improved with each category of increasing β-cell graft function. CONCLUSIONS Future Igls 2.0 criteria should consider absolute rather than relative levels of insulin use and C-peptide as qualifiers with treatment success based on glucose assessment using CGM metrics on par with assessment of glycated hemoglobin and severe hypoglycemia events.
Collapse
|