Analytical approaches and estimands to take account of missing patient-reported data in longitudinal studies

Statistical analysis plan for the PRO B study: open-label, superiority randomised controlled trial of alarm-based patient-reported outcome monitoring in patients with metastatic breast cancer

BACKGROUND

With an increasing collection of patient-reported outcomes (PROs) to measure health-related quality of life (HRQoL) in oncological patients, there is still a lack of standardised strategies on how to interpret and use these data in patient care. Prior research has shown support for the use of digital PRO monitoring together with alarm systems to notify clinicians when the PRO values are deteriorating. This system has demonstrated advantages in improving HRQoL and increasing survival rates among oncology patients. Hence, we designed the PRO B study, a superiority multi-centre randomised controlled trial, to investigate the effects of alarm-based monitoring in metastatic breast cancer patients in Germany. The study protocol for the PRO B study was published in September 2021, and this manuscript describes a formal statistical analysis plan (SAP) for the PRO B study to improve the transparency and quality of this trial.

METHODS AND DESIGN

The trial aimed to recruit 1000 patients with metastatic breast cancer. However, as of the completion of recruitment on June 15, 2023, we have successfully enrolled 924 patients from 52 breast cancer centres. Patients were 1:1 stratified randomised to the intervention and control groups. App-based PRO questionnaires are sent weekly to the intervention group and every 3 months to the control group. Only patients in the intervention group trigger an alarm if their PRO scores deteriorate, and they are subsequently contacted by the local care team within 48 h. The primary outcome is the fatigue score at 6 months, and secondary outcomes are other HRQoL and overall survival. Evaluation of the superiority of the intervention will be done using a linear mixed model with random intercepts for study centres.

CONCLUSION

This detailed SAP defines the main components of the statistical analysis for the PRO B study to assist the statistician and prevent bias in selecting analysis and reporting findings. Version 1 of the SAP was finalised on January 18, 2024.

TRIAL REGISTRATION

DRKS (German Clinical Trials Register) DRKS00024015 . Registered on February 15, 2021.

[Special issue PRO] Considering endpoints for comparative tolerability of cancer treatments using patient report given the estimand framework

Regulatory agencies are advancing the use of systematic approaches to collect patient experience data, including patient-reported outcomes (PROs), in cancer clinical trials to inform regulatory decision-making. Due in part to clinician under-reporting of symptomatic adverse events, there is a growing recognition that evaluation of cancer treatment tolerability should include the patient experience, both in terms of the overall side effect impact and symptomatic adverse events. Methodologies around implementation, analysis, and interpretation of "patient" reported tolerability are under development, and current approaches are largely descriptive. There is robust guidance for use of PROs as efficacy endpoints to compare cancer treatments, but it is unclear to what extent this can be relied-upon to develop tolerability endpoints. An important consideration when developing endpoints to compare tolerability between treatments is the linkage of trial design, objectives, and statistical analysis. Despite interest in and frequent collection of PRO data in oncology trials, heterogeneity in analyses and unclear PRO objectives mean that design, objectives, and analysis may not be aligned, posing substantial challenges for the interpretation of results. The recent ICH E9 (R1) estimand framework represents an opportunity to help address these challenges. Efforts to apply the estimand framework in the context of PROs have primarily focused on efficacy outcomes. In this paper, we discuss considerations for comparing the patient-reported tolerability of different treatments in an oncology trial context.

Increasing the delivery of upper limb constraint-induced movement therapy programs for stroke and brain injury survivors: evaluation of the ACTIveARM project

PURPOSE

To increase the number of constraint-induced movement therapy (CIMT) programs provided by rehabilitation services.

METHODS

A before-and-after implementation study involving nine rehabilitation services. The implementation package to help change practice included file audit-feedback cycles, 2-day workshops, poster reminders, a community-of-practice and drop-in support. File audits were conducted at baseline, every three months for 1.5 years, and once after support ceased to evaluate maintenance of change. CIMT participant outcomes were collected to evaluate CIMT effectiveness and maintenance (Action Research Arm Test and Motor Activity Log). Staff focus groups explored factors influencing CIMT delivery.

RESULTS

CIMT adoption improved from baseline where only 2% of eligible people were offered and/or received CIMT (n = 408 files) to more than 50% over 1.5 years post-implementation (n = 792 files, 52% to 73% offered CIMT, 27%-46% received CIMT). Changes were maintained at 6-month follow-up (n = 172 files, 56% offered CIMT, 40% received CIMT). CIMT participants (n = 74) demonstrated clinically significant improvements in arm function and occupational performance. Factors influencing adoption included interdisciplinary collaboration, patient support needs, intervention adaptations, a need for continued training, and clinician support.

CONCLUSIONS

The implementation package helped therapists overcome an evidence-practice gap and deliver CIMT more routinely.

Reflections on estimands for patient-reported outcomes in cancer clinical trials

It is common and important to include the patient's perspective of the impact of treatment on health-related quality of life (HRQoL) outcomes. In this commentary, we focus on applying the new addendum to ICH E9 guideline E9 (R1) relating to the estimand framework to Patient Reported Outcomes (PROs) collected in cancer clinical trials, from a statistician's viewpoint. Currently, common practice for statistical analysis of PRO endpoints of published cancer clinical trials demonstrates ambiguity, leaving critical questions unspecified, hindering conclusions about the effect of treatment on PRO endpoints as well as comparability between clinical trials. To avoid this scenario, we advocate the systematic use of the estimand framework which requires the prospective definition of clear PRO research questions. Among the five attributes of the estimands framework, the definition of the endpoint (what is the right PRO measure and timeframe to target and why?), the intercurrent event identification and management (what happens with PRO data post-disease progression, what is the impact of death?) and the population-level summary (what is an acceptable statistical summary for PRO data?) require the most attention for PRO estimands. We identify good practice and highlight discussion points including the challenges of statistical analysis in the presence of missing and/or unobservable data and in relation to death. Through this discussion we highlight that there is no "statistical magic", but that the estimand framework will help you find out what you really want to know when quantifying the benefit of treatments from the patients' perspective.

Information about missing patient-reported outcome data in breast cancer trials is frequently not documented: a scoping review

OBJECTIVES

This review addresses the common problem of missing patient-reported outcome (PRO) data in clinical trials by assessing the current practice of their statistical handling as reported in publications of randomized controlled trials (RCTs) in patients with breast cancer.

STUDY DESIGN AND SETTING

We searched PubMed to identify RCTs evaluating biomedical treatments in breast cancer patients with at least one PRO endpoint published between January 2019 and February 2022. Two reviewers independently assessed the eligibility of the publications for this scoping review and extracted prespecified information on missing PRO data and related statistical practices.

RESULTS

Of 1,598 publications identified, 118 trials met the inclusion criteria. Eighty-eight (74.6%) trials reported the extent of missing data, with 11 (9.3%) not containing any missing PRO data. Twenty-one (19.6%) trials explicitly stated the statistical approach for handling missing data, with a preference for single imputation over multiple imputation approaches (57.2%/19.0%). Only six (5.6%) trials reported a sensitivity analysis to examine the extent to the results being affected by changes in assumptions made about missing PRO data.

CONCLUSION

International efforts to raise awareness of the importance of accurately reporting state-of-the-art handling of missing PRO data are not yet fully reflected in the current literature of breast cancer RCTs.

A Retrospective Medical Record Review of Adults with Non-Cancer Diagnoses Prescribed Medicinal Cannabis

Research describing patients using medicinal cannabis and its effectiveness is lacking. We aimed to describe adults with non-cancer diagnoses who are prescribed medicinal cannabis via a retrospective medical record review and assess its effectiveness and safety. From 157 Australian records, most were female (63.7%; mean age 63.0 years). Most patients had neurological (58.0%) or musculoskeletal (24.8%) conditions. Medicinal cannabis was perceived beneficial by 53.5% of patients. Mixed-effects modelling and post hoc multiple comparisons analysis showed significant changes overtime for pain, bowel problems, fatigue, difficulty sleeping, mood, quality of life (all p < 0.0001), breathing problems (p = 0.0035), and appetite (p = 0.0465) Symptom Assessment Scale scores. For the conditions, neuropathic pain/peripheral neuropathy had the highest rate of perceived benefit (66.6%), followed by Parkinson's disease (60.9%), multiple sclerosis (60.0%), migraine (43.8%), chronic pain syndrome (42.1%), and spondylosis (40.0%). For the indications, medicinal cannabis had the greatest perceived effect on sleep (80.0%), followed by pain (51.5%), and muscle spasm (50%). Oral oil preparations of balanced delta-9-tetrahydrocannabinol/cannabidiol (average post-titration dose of 16.9 mg and 34.8 mg per day, respectively) were mainly prescribed. Somnolence was the most frequently reported side effect (21%). This study supports medicinal cannabis' potential to safely treat non-cancer chronic conditions and indications.

The underpinning factors of NBA game-play performance: a systematic review (2001-2020)

OBJECTIVE

Recognizing the high stakes associated with winning and losing in the National Basketball Association (NBA), a deep understanding of the underlying mechanisms of NBA game-play performance would provide substantial benefit to all stakeholders involved with preparing NBA players and teams for competitive success. To the best of the authors' knowledge, this systematic review presents the first attempt to systematically amalgamate and appraise the scientific literature published in the XXI Century, following a constraints-led approach (CLA). In particular, two underpinning factors of NBA game-play performance were investigated: (1) NBA player constraints (internal variables) and (2) NBA contextual constraints (external variables).

METHODS

Databases included PubMed (MEDLINE), Web of Science (WOS), ResearchGate, SPORTDiscus, SCOPUS, Google Scholar, and the World Association of Basketball Coaches' database (WABC). This review followed the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) model and the Population, Intervention, Comparison and Outcomes (PICOS) guidelines.

RESULTS

Ultimately, 43 articles met the inclusion criteria (n = 43). Promisingly, the vast majority of studies were published in recent years (>2016; n = 28; 65.1%). Topics related to 'contextual constraints' (n = 25; 58.1%) received more attention than topics related to 'player constraints' (n = 18; 41.9%). Even though the importance of longitudinal-interventional approaches to applied sports science is well-documented, descriptive-observational research emerged as the most popular method of choice (n = 27; 62.8%); interventional studies were absent; and near all researchers merely utilized secondary data sources (n = 37; 86.0%).

CONCLUSIONS

Taking into account the total body of evidence (2001-2020), NBA practitioners may use this systematic review as a baseline reference to enrich their current knowledge about the nature, demands, and dynamics of the modern-day NBA ecosystem. Finally, adoption of an 'Applied Science Research Framework' is encouraged, fostering clearly outlined project incentives; standardizing taxonomies; sequencing follow-up studies; embracing holistic and cross-disciplinary viewpoints; and integrating longitudinal-interventional projects to increase the reproducibility of their findings.

Patient-reported outcomes in patients with hematological relapse or progressive disease: a longitudinal observational study

Background

Patients with hematological cancer who experience relapse or progressive disease often face yet another line of treatment and continued mortality risk that could increase their physical and emotional trauma and worsen their health-related quality of life. Healthcare professionals who use patient-reported outcomes to identify who will have specific sensitivities in particular health-related quality of life domains may be able to individualize and target treatment and supportive care, both features of precision medicine. Here, in a cohort of patients with relapsed or progressive hematological cancer, we sought to identify health-related quality of life domains in which they experienced deterioration after relapse treatment and to investigate health-related quality of life patterns.

Method

Patients were recruited in connection with a precision medicine study at the Department of Hematology, Aalborg University Hospital. They completed the European Organization for Research and Treatment of Cancer questionnaire and the Hospital Anxiety and Depression Scale at baseline and at 3, 6, 9, and 12 months after the relapse diagnosis or progressive cancer. Modes of completion were electronically or on paper. Clinically relevant changes from baseline to 12 months were interpreted according to Cocks’ guidelines. We quantified the number of patients with moderate or severe symptoms and functional problems and the number who experienced improvements or deterioration from baseline to 12 months.

Results

A total of 104 patients were included, of whom 90 (87%) completed baseline questionnaires and 50 (56%) completed the 12-month assessments. The three symptoms that patients most often reported as deteriorating were fatigue (18%), insomnia (18%), and diarrhea (18%). The three functions that patients most often reported as deteriorating were role (16%) and emotional (16%) and cognitive (16%) functioning.

Conclusion

In this study, patient-reported outcome data were useful for identifying negatively affected health-related quality of life domains in patients with relapsed or progressive hematological cancer. We identified patients experiencing deterioration in health-related quality of life during treatment and characterized a potential role for patient-reported outcomes in precision medicine to target treatment and supportive care in this patient group.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01887-6.

Comparing Email, SMS, and Concurrent Mixed Modes Approaches to Capture Quality of Recovery in the Perioperative Period: Retrospective Longitudinal Cohort Study

Background

As patients are discharged from the hospital more quickly, the ability to monitor patient recovery between hospital discharge and the first follow-up clinic visit is becoming increasingly important. Despite substantial increase in both internet use and smartphone ownership over the past 5 years, clinicians have been slow to embrace the use of these devices to capture patient recovery information in the period between hospital discharge and the first clinical follow-up appointment.

Objective

This study aims to investigate the generalizability of using a web-based platform to capture patient recovery in a broad surgical patient population and compare response rates for 3 different web-based strategies for delivering recovery surveys over the perioperative period: email, SMS text messaging, and a concurrent mixed approach of using both email and SMS text messaging.

Methods

Patients undergoing surgeries managed with an enhanced recovery after surgery pathway were asked to participate in a web-based quality assurance monitoring program at the time of their preoperative surgery appointment. Different follow-up methods were implemented over 3 sequential phases. Patients received Health Insurance Portability and Accountability Act–compliant web-based survey links via email (phase 1), SMS text messaging (phase 2), or concurrently using both email and SMS text messaging (phase 3) using REDCap and Twilio software. Recovery assessments using the established Quality of Recovery-9 instrument were performed 4 days before surgery and at 7 and 30 days postoperatively. Generalizability of the web-based system was examined by comparing characteristics of those who participated versus those who did not. Differences in response rates by the web-based collection method were analyzed using adjusted models.

Results

A total of 615 patients were asked to participate, with 526 (85.5%) opting for the follow-up program. Those who opted in were younger, slightly healthier, and more likely to be in a partnership. The concurrent mixed modes method was the most successful for obtaining responses at each time point compared with text or email alone (pre: 119/160, 74.4% vs 116/173, 67.1% vs 56/130, 43.1%, P<.001; 7 days: 115/172, 66.9% vs 82/164, 50.0% vs 59/126, 46.8%, P=.001; 30 days: 152/234, 65.0% vs 52/105, 49.5% vs 53/123, 43.1%, P=.001, respectively). In the adjusted model, the concurrent mixed modes method significantly predicted response compared with using email alone (odds ratio 3.4; P<.001) and SMS text messaging alone (odds ratio 1.9; P<.001). Additional significant predictors of response were race, partnership, and time.

Conclusions

For internet users and smartphone owners, electronic capture of recovery surveys appear to be possible through this mechanism. Discrepancies in both inclusion and response rates still exist among certain subgroups of patients, but the concurrent approach of using both email and text messages was the most effective approach to reach the largest number of patients across all subgroups.

Rehabilitation of executive function in chronic paediatric brain injury: a randomized controlled trial

BACKGROUND

Impaired executive functions (EFs, i.e., purposeful, goal-directed behaviour) cause significant disability after paediatric acquired brain injury (pABI) warranting efficient interventions. Goal Management Training (GMT) is a metacognitive protocol proven effective for executive dysfunction in adults. This pre-registered, blinded, parallel-randomized controlled trial evaluated efficacy of a paediatric adaptation (pGMT) compared to a psychoeducative control (paediatric Brain Health Workshop, pBHW) to improve EF.

METHODS

Children aged 10 to 17 years with pABI (e.g., traumatic brain injury, brain tumour), ≥ 1 year post-onset or ended treatment, with parent-reported EF complaints were eligible. Participants were randomized (computer-algorithm) to either group-based pGMT (n = 38) or pBHW (n = 38). The active control was tailored to keep non-specific factors constant. Thus, both treatments comprised of 7 sessions at hospitals over 3 consecutive weeks, followed by 4 weeks of telephone counselling of participants, parents, and teachers. Parent-reported daily life EF, assessed by the questionnaire Behavior Rating Inventory of Executive Function (BRIEF; Behavioral Regulation Index (BRI) and Metacognition Index (MI)), were co-primary outcomes 6 months post-intervention. Secondary outcomes included neuropsychological tests and a complex naturalistic task (Children's Cooking Task).

RESULTS

Seventy-three participants (96%) completed allocated interventions and 71 (93%) attended the 6-month follow-up. The results demonstrated no significant difference in effectiveness for the two interventions on parent-reported EF: For BRIEFBRI, mean (SD) raw score for pGMT was 42.7 (8.8) and 38.3 (9.3) for pBHW. Estimated difference was - 2.3 (95% CI - 5.1 to 0.6). For BRIEFMI, the corresponding results were 80.9 (20.4) for GMT and 75.5 (19.3) for pBHW. Estimated difference was - 1.4 (95% CI -8.5 to 5.8). In performance-based tests, pGMT was associated with improved inhibition and executive attention, while pBHW was associated with fewer errors in the naturalistic task.

CONCLUSIONS

In pABI, metacognitive training (pGMT) did not demonstrate additional effectiveness on parent-reported daily life EF at 6-month follow-up, when compared to a psychoeducative control. Both interventions were well-tolerated and demonstrated distinct improvements at different EF assessment levels. To conclude on pGMT efficacy, larger studies are needed, including further investigation of appropriate assessment levels and possible differences in effect related to treatment duration, developmental factors, and injury characteristics.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT0321534211, 11 July 2017.

Risk Prediction Models for Inadvertent Intraoperative Hypothermia: A Systematic Review

PURPOSES

Inadvertent intraoperative hypothermia (core temperature <36°C) is a common surgical complication with several adverse events. Hypothermia prediction models can be a tool for providing the healthcare staff with information on the risk of inadvertent hypothermia. Our systematic review aimed to identify, demonstrate, and evaluate the available intraoperative hypothermia risk prediction models in surgical populations.

DESIGN

This study is a systematic review of literature.

METHODS

We systematically searched multiple databases (Ovid MEDLINE, Web of Science, Embase, and Cochrane Center Register of Controlled Trials). Two reviewers independently examined abstracts and the full text for eligibility. Data collection was guided by the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS checklist), and methodological quality and applicability were assessed by the Prediction model Risk Of Bias ASsessment Tool (PROBAST).

FINDINGS

A total of 3,672 references were screened, of which eight articles were included in this study. All the models had a high risk of bias since most of them lacked model validation. Also, they failed to report the model performance and final model presentations, which restricted their clinical application.

CONCLUSIONS

The researchers should present models in a more standard way and improve the existing models to increase their predictive values for clinical application.