1
|
Factors predicting missing instruments in three cancer randomized clinical trials. Qual Life Res 2021; 30:2219-2234. [PMID: 33797688 DOI: 10.1007/s11136-021-02818-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/05/2021] [Indexed: 10/21/2022]
Abstract
PURPOSE Missing patient-reported outcome (PRO) data can seriously threaten the validity of randomized clinical trials (RCTs). Identifying which factors predict missing instruments may help researchers develop strategies to prevent it from happening. This study examined the association of factors with time to the first missing instrument after randomization in three cooperative group RCTs. METHODS We performed descriptive analyses and Cox proportional hazards regressions for three RCTs selected from the Canadian Cancer Trials Group: MA17 (breast cancer), PR7 (prostate cancer), and LY12 (non-Hodgkin's lymphoma). The outcome was the time from randomization to the first missing instrument. Variables for 15 factors were used as covariates based on availability and previously-reported putative associations with missing PRO data. RESULTS Nine percent of 1352 subjects on MA17, 37% of 923 subjects on PR7, and 59% of 477 subjects on LY12 had a missing instrument. Twenty-five percent of subjects on MA17 had first missing instrument within 4.6 years. The median time to first missing instrument was: not observed for MA17, 7.3 years for PR7, 0.12 years for LY12. Cox regression revealed statistically significant independent associations with outcome for only five factors: baseline age (PR7) and level of well-being (LY12), and centre level of activity (LY12), presence of post-graduate residency training program (MA17, PR7), and centre geographic location (PR7, LY12). CONCLUSION Many factors reported to have association with missing instruments do not seem to predict time to the first missing instrument after randomization in RCTs. Context is important in understanding the few that may.
Collapse
|
2
|
Palmer MJ, Mercieca-Bebber R, King M, Calvert M, Richardson H, Brundage M. A systematic review and development of a classification framework for factors associated with missing patient-reported outcome data. Clin Trials 2017; 15:95-106. [PMID: 29124956 DOI: 10.1177/1740774517741113] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND/AIMS Missing patient-reported outcome data can lead to biased results, to loss of power to detect between-treatment differences, and to research waste. Awareness of factors may help researchers reduce missing patient-reported outcome data through study design and trial processes. The aim was to construct a Classification Framework of factors associated with missing patient-reported outcome data in the context of comparative studies. The first step in this process was informed by a systematic review. METHODS Two databases (MEDLINE and CINAHL) were searched from inception to March 2015 for English articles. Inclusion criteria were (a) relevant to patient-reported outcomes, (b) discussed missing data or compliance in prospective medical studies, and (c) examined predictors or causes of missing data, including reasons identified in actual trial datasets and reported on cover sheets. Two reviewers independently screened titles and abstracts. Discrepancies were discussed with the research team prior to finalizing the list of eligible papers. In completing the systematic review, four particular challenges to synthesizing the extracted information were identified. To address these challenges, operational principles were established by consensus to guide the development of the Classification Framework. RESULTS A total of 6027 records were screened. In all, 100 papers were eligible and included in the review. Of these, 57% focused on cancer, 23% did not specify disease, and 20% reported for patients with a variety of non-cancer conditions. In total, 40% of the papers offered a descriptive analysis of possible factors associated with missing data, but some papers used other methods. In total, 663 excerpts of text (units), each describing a factor associated with missing patient-reported outcome data, were extracted verbatim. Redundant units were identified and sequestered. Similar units were grouped, and an iterative process of consensus among the investigators was used to reduce these units to a list of factors that met the guiding principles. The list was organized on a framework, using an iterative consensus-based process. The resultant Classification Framework is a summary of the factors associated with missing patient-reported outcome data described in the literature. It consists of 5 components (instrument, participant, centre, staff, and study) and 46 categories, each with one or more sub-categories or examples. CONCLUSION A systematic review of the literature revealed 46 unique categories of factors associated with missing patient-reported outcome data, organized into 5 main component groups. The Classification Framework may assist researchers to improve the design of new randomized clinical trials and to implement procedures to reduce missing patient-reported outcome data. Further research using the Classification Framework to inform quantitative analyses of missing patient-reported outcome data in existing clinical trials and to inform qualitative inquiry of research staff is planned.
Collapse
Affiliation(s)
- Michael J Palmer
- 1 Department of Public Health Sciences, Queen's University, Kingston, ON, Canada.,2 Division of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - Rebecca Mercieca-Bebber
- 3 Central Clinical School, Sydney Medical School, The University of Sydney, Sydney, NSW, Australia.,4 Psycho-oncology Co-operative Research Group, School of Psychology, The University of Sydney, Sydney, NSW, Australia.,5 Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, UK
| | - Madeleine King
- 3 Central Clinical School, Sydney Medical School, The University of Sydney, Sydney, NSW, Australia.,4 Psycho-oncology Co-operative Research Group, School of Psychology, The University of Sydney, Sydney, NSW, Australia
| | - Melanie Calvert
- 5 Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, UK.,6 Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Harriet Richardson
- 1 Department of Public Health Sciences, Queen's University, Kingston, ON, Canada.,2 Division of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - Michael Brundage
- 1 Department of Public Health Sciences, Queen's University, Kingston, ON, Canada.,2 Division of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| |
Collapse
|
3
|
Mercieca-Bebber R, Palmer MJ, Brundage M, Calvert M, Stockler MR, King MT. Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review. BMJ Open 2016; 6:e010938. [PMID: 27311907 PMCID: PMC4916640 DOI: 10.1136/bmjopen-2015-010938] [Citation(s) in RCA: 69] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2015] [Revised: 05/04/2016] [Accepted: 05/18/2016] [Indexed: 11/21/2022] Open
Abstract
OBJECTIVES Patient-reported outcomes (PROs) provide important information about the impact of treatment from the patients' perspective. However, missing PRO data may compromise the interpretability and value of the findings. We aimed to report: (1) a non-technical summary of problems caused by missing PRO data; and (2) a systematic review by collating strategies to: (A) minimise rates of missing PRO data, and (B) facilitate transparent interpretation and reporting of missing PRO data in clinical research. Our systematic review does not address statistical handling of missing PRO data. DATA SOURCES MEDLINE and Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases (inception to 31 March 2015), and citing articles and reference lists from relevant sources. ELIGIBILITY CRITERIA English articles providing recommendations for reducing missing PRO data rates, or strategies to facilitate transparent interpretation and reporting of missing PRO data were included. METHODS 2 reviewers independently screened articles against eligibility criteria. Discrepancies were resolved with the research team. Recommendations were extracted and coded according to framework synthesis. RESULTS 117 sources (55% discussion papers, 26% original research) met the eligibility criteria. Design and methodological strategies for reducing rates of missing PRO data included: incorporating PRO-specific information into the protocol; carefully designing PRO assessment schedules and defining termination rules; minimising patient burden; appointing a PRO coordinator; PRO-specific training for staff; ensuring PRO studies are adequately resourced; and continuous quality assurance. Strategies for transparent interpretation and reporting of missing PRO data include utilising auxiliary data to inform analysis; transparently reporting baseline PRO scores, rates and reasons for missing data; and methods for handling missing PRO data. CONCLUSIONS The instance of missing PRO data and its potential to bias clinical research can be minimised by implementing thoughtful design, rigorous methodology and transparent reporting strategies. All members of the research team have a responsibility in implementing such strategies.
Collapse
Affiliation(s)
- Rebecca Mercieca-Bebber
- Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia
- Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Michael J Palmer
- Department of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, Ontario, Canada
| | - Michael Brundage
- Department of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, Ontario, Canada
| | - Melanie Calvert
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Martin R Stockler
- Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia
- NHMRC Clinical Trials Centre, University of Sydney, Camperdown, New South Wales, Australia
| | - Madeleine T King
- Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia
- Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
4
|
Pain questionnaire performance in advanced prostate cancer: comparative results from two international clinical trials. Qual Life Res 2013; 22:2777-86. [PMID: 23589119 DOI: 10.1007/s11136-013-0411-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/08/2013] [Indexed: 12/22/2022]
Abstract
PURPOSE To compare pain assessment questionnaires commonly used in advanced prostate cancer trials and to determine the psychometric characteristics and longitudinal relationships by contrasting questionnaire data from two international phase 2 trials. METHODS Scores from the Present Pain Intensity (PPI) question of the McGill Pain Questionnaire, the pain intensity scale of the Brief Pain Inventory (BPI), and the Functional Assessment of Cancer Therapy-Prostate (FACT-P) were analyzed using Pearson correlation, intraclass correlation coefficient, and Cronbach's α, respectively. Concordance was evaluated with Cohen's kappa coefficient and McNemar test at baseline (n = 224) and two subsequent observations. RESULTS PPI and FACT-P scores were associated with the BPI score at baseline for Trials 1 and 2: PPI r = 0.66 and 0.80, respectively (P < 0.001); FACT-P (pain scale) r = -0.76 and -0.82, respectively (P < 0.001). However, concordance analysis revealed that the BPI identified pain (score > 0) at higher rates than the PPI: at baseline, BPI: 89 % (64/72) and 77 % (95/124), PPI: 68 % (49/72) and 64 % (79/124) [Trials 1 and 2, respectively; McNemar test (P < 0.001) for both studies]. The FACT-P pain scale identified pain similarly to the BPI pain intensity scale; longitudinal analysis produced comparable findings. All pain scales met standard psychometric acceptability criteria, but the BPI and FACT-P performed better than the PPI. CONCLUSIONS Data suggest the BPI pain intensity and FACT-P pain scales are better than the PPI question at capturing the pain experience among patients with advanced prostate cancer. Additional comparative research is needed in larger population samples.
Collapse
|
5
|
Inter-professional variability in the assignment and recording of acute toxicity grade using the RTOG system during prostate radiotherapy. Radiother Oncol 2009; 90:395-9. [PMID: 19135748 DOI: 10.1016/j.radonc.2008.12.003] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2008] [Revised: 11/25/2008] [Accepted: 12/08/2008] [Indexed: 11/22/2022]
Abstract
BACKGROUND AND PURPOSE To compare the routine acute toxicity documentation practices of therapists and oncologists using the RTOG lower GI and GU scales. METHODS AND MATERIALS Ninety consecutive prostate radiotherapy patients were identified. The weekly urinary and rectal acute toxicity grades routinely documented by therapists and oncologists were collected retrospectively from radiotherapy charts. These data were paired together, and compared between the professional groups. RESULTS Only RTOG acute toxicity grades between 0 and 2 were recorded by either group. The overall rate of documentation was high (97% therapists/86% oncologists), but the rate of quantitative documentation was low from the oncologists (46%) who used a free-form text field for recording purposes. There was no significant difference in the incidence of maximum grade of acute toxicity reported by either professional group (p>0.1). There was good RTOG score concordance between the observer groups (kappa=0.756), with pair-wise absolute agreement in 76%. Pair-wise discrepancies between the observers were commonly attributable to differences in the time/date of assessment. CONCLUSIONS Despite some methodological limitations, this study found that therapist-assessed RTOG acute toxicity grades demonstrated a good level of agreement with the grades assigned by their oncologist colleagues.
Collapse
|
6
|
Calvert MJ, Skelton JR. The need for education on health related-quality of life. BMC MEDICAL EDUCATION 2008; 8:2. [PMID: 18194541 PMCID: PMC2222608 DOI: 10.1186/1472-6920-8-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2007] [Accepted: 01/14/2008] [Indexed: 05/13/2023]
Abstract
BACKGROUND Health-related quality of life is increasingly recognised as an important outcome measure that complements existing measures of clinical effectiveness. The education available on this subject for different healthcare professionals is varied. This article describes the design, implementation and evaluation of a Special Study Module on Health-Related Quality of Life for undergraduate medical students at the University of Birmingham. METHODS The course involves 10 hours of "guided discovery learning" covering core concepts of Health-Related Quality of Life assessment including methodological considerations, use in clinical trials, routine practice and in health policy followed by self-directed learning. The taught components aim to provide students with the skills and knowledge to enable them to explore and evaluate the use of quality of life assessments in a particular patient group, or setting, through self-directed learning supported by tutorials. RESULTS The use of case studies, recent publications and research, and discussion with a research oncology nurse in task-based learning appeared to provide students with a stimulating environment in which to develop their ideas and was reflected in the diverse range of subjects chosen by students for self-directed study and the positive feedback on the module. Course evaluation and student assessment suggests that quality of life education appears to integrate well within the medical curriculum and allows students to develop and utilise skills of time-management and independent, self-directed learning that can be applied in any context. CONCLUSION We suggest that education and training initiatives in quality of life may improve the quality of studies, and help bridge the gap between research and clinical practice. Resources for curriculum development on health-related quality of life have been developed by the International Society for Quality of Life Research and may prove a useful tool to educators interested in this area.
Collapse
Affiliation(s)
- Melanie J Calvert
- Department of Primary Care and General Practice, University of Birmingham, UK
| | - John R Skelton
- Department of Primary Care and General Practice, University of Birmingham, UK
| |
Collapse
|
7
|
Land SR, Ritter MW, Costantino JP, Julian TB, Cronin WM, Haile SR, Wolmark N, Ganz PA. Compliance with patient-reported outcomes in multicenter clinical trials: methodologic and practical approaches. J Clin Oncol 2007; 25:5113-20. [PMID: 17991930 DOI: 10.1200/jco.2007.12.1749] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE This report describes interventions undertaken by the National Surgical Adjuvant Breast and Bowel Project (NSABP) to improve compliance with patient-reported outcome (PRO) assessments in the setting of multicenter cancer clinical trials. We describe the effectiveness of several interventions and of observational factors. METHODS PRO submission rates were analyzed for the following three NSABP protocols: the Study of Raloxifene and Tamoxifen (STAR), B-32, and B-35. Institutions participating in protocol B-35 were randomly assigned to receive automated reminders of upcoming assessments or not. Compliance was analyzed with a logistic repeated measures mixed modeling. RESULTS Compliance was high in the three protocols, with rates greater than 80% for nearly all time points. Institutions were a significant source of variability (P < .01). The largest institutions had the highest compliance in STAR (odds ratio [OR] = 0.68 for < 50 participants enrolled and OR = 0.82 for 50 to 99 participants enrolled v larger institutions; P < .001). Midsized institutions had highest compliance in B-32 (OR = 4.63 for 31 to 50 patients enrolled and OR = 3.12 for > 50 patients enrolled v small institutions; P = .007). Compliance increased with participant age in STAR (OR = 0.57, 0.89, and 1.01 for ages < 50, 50 to 60, and 60 to 70 years, respectively, v > 70 years; P < .001). Race was significant in B-32 (OR = 2.63 for white v nonwhite; P < .001) and in STAR (OR = 1.41 for white v nonwhite; P < .001). Treatment group was significant in B-32 (OR = 0.74; P = .006). The B-35 prospective reminder did not improve compliance significantly (P = .30), but in B-32, delinquency sanctions were significant (OR = 1.56; P = .007). CONCLUSION Compliance in NSABP PRO studies is higher now than a decade ago. Results for compliance initiatives were mixed. Age and race are important factors, but institutional variation remains significant and largely unexplained.
Collapse
Affiliation(s)
- Stephanie R Land
- National Surgical Adjuvant Breast and Bowel Project Operations and Biostatistical Centers, Pittsburgh, PA 15213, USA.
| | | | | | | | | | | | | | | |
Collapse
|
8
|
Janda M, Gebski V, Forder P, Jackson D, Williams G, Obermair A. Total laparoscopic versus open surgery for stage 1 endometrial cancer: The LACE randomized controlled trial. Contemp Clin Trials 2006; 27:353-63. [PMID: 16678497 DOI: 10.1016/j.cct.2006.03.004] [Citation(s) in RCA: 46] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2005] [Revised: 01/25/2006] [Accepted: 03/12/2006] [Indexed: 10/24/2022]
Abstract
PURPOSE Endometrial cancer is the most common gynaecological malignancy in Australia and the US. Current standard treatment involves open surgery to remove the uterus, and both tubes and ovaries (TAH). The Laparoscopic Approach to Cancer of the Endometrium (LACE) trial was designed to assess equivalence of performing this in a total laparoscopic approach (TLH). METHODS Patient recruitment was designed to proceed along two stages to accommodate for a potential increase in patient requests of laparoscopic surgery. During the first stage, patients are randomised in a 2:1 allocation to receive TLH or TAH, with the primary endpoint quality of life (QoL) at 6 month post-surgery, requiring 180 patients to be enrolled to have 80% power at alpha=0.05 to detect a clinically significant difference of 8 points on the Functional Assessment of Cancer General (FACT-G) QoL instrument. If additional recruitment of patients seems impossible after accrual of 180 patients, this cohort will be followed for 4 years, and disease free survival (DFS) of patients treated by TLH will be compared to DFS within the endometrial cancer population. During the second stage, recruitment will be extended to a total of 590 patients in a 1:1 TLH:TAH allocation, to assess the equivalence with respect to DFS with 80% power and alpha=0.05. Equivalence will be assumed if the difference in DFS does not exceed 7% at 4 years. Secondary outcomes include treatment related morbidity; costs and cost-effectiveness; patterns of recurrence; and overall survival. All data from this multicentre study will be entered using online electronic case report forms (e-CRF), allowing real time assessment of data completeness and patient follow-up. CONCLUSIONS The LACE trial will establish the equivalence of a TLH approach for patients with stage 1 endometrial cancer following a two stage protocol to accommodate potential threats to patient recruitment through requests for laparoscopic surgery.
Collapse
Affiliation(s)
- M Janda
- Queensland University of Technology, Centre for Health Research-Public Health, Kelvin Grove, Brisbane, Queensland, Australia
| | | | | | | | | | | |
Collapse
|
9
|
Cheung YB, Daniel R, Ng GY. Response and non-response to a quality-of-life question on sexual life: a case study of the simple mean imputation method. Qual Life Res 2006; 15:1493-501. [PMID: 16732467 DOI: 10.1007/s11136-006-0004-1] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/02/2006] [Indexed: 11/25/2022]
Abstract
We investigated the non-response rates to the question "I am satisfied with my sex life" in the Functional Assessment of Cancer Therapy-General questionnaire in Chinese (n = 769), Malay (n = 41) and Indian (n = 33) patients in Singapore, a multi-ethnic society whose residents are said to have a conservative sexual attitude. Non-response rates to the question were 44%, 22% and 24% in the three groups respectively. The rates were much higher than that reported previously in a US study (7%) and used in the associated simulation study of the simple mean imputation method. We further examined the Chinese respondents in detail. The odds of non-response and the scores among the responders were associated with several demographic and clinical characteristics. Using the checklist proposed by Fayers et al. [Stat Med 1998; 17: 679-696] to assess the data patterns, we found that the application of the simple mean imputation is questionable. We employed an alternative (multiple) imputation procedure that took into account covariates that predicted the odds of non-response and the observed response scores. We compared the analytic results based on different approaches to handling missing values, and found that analysis based on the simple mean imputation gave results similar to that based on multiply imputed data even in this quite extreme example.
Collapse
Affiliation(s)
- Yin Bun Cheung
- Division of Clinical Trials and Epidemiological Sciences, National Cancer Centre, Singapore, Singapore.
| | | | | |
Collapse
|
10
|
Steel JL, Geller DA, Carr BI. Proxy ratings of health related quality of life in patients with hepatocellular carcinoma. Qual Life Res 2005; 14:1025-33. [PMID: 16041898 DOI: 10.1007/s11136-004-3267-4] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
The present study prospectively assessed consistency of ratings of health-related quality of life between patients with hepatocellular carcinoma and two types of proxy raters, family caregivers and oncologist care providers. Patients and proxies completed the Functional Assessment of Cancer Therapy-Hepatobiliary (FACT-Hep) at baseline prior to treatment (82 patients plus proxies), at 3-months (32 patients plus proxies), and 6-months follow up (16 patients plus proxies) after diagnosis. Patient and proxy demographic data and patient medical data were also collected. At baseline, significant intra-class correlations (ICC) were found for patient--caregiver ratings of physical, social/family, and functional well-being, additional concerns (symptoms, side effects), and overall health related quality of life (HRQL); for patient--care provider ratings of physical well-being; and for caregiver--care provider ratings of physical and emotional well-being. At 3-months follow-up, the most significant number of ICCs were recorded across all three rater pairs. Significant consistencies were found for overall HRQL, and all subscale scores except for social and family well-being. The fewest significant ICCs were found at the 6-month follow-up, and were for patient--caregiver ratings of physical and functional well-being, and additional concerns; and for caregiver--care provider ratings on overall HRQL. These results suggest that family caregivers are adequate proxies of patient physical and functional well-being and additional concerns throughout the patient's illness, more so than oncologist care providers. Further research is warranted with larger samples.
Collapse
|
11
|
Manca A, Palmer S. Handling missing data in patient-level cost-effectiveness analysis alongside randomised clinical trials. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2005; 4:65-75. [PMID: 16162026 DOI: 10.2165/00148365-200504020-00001] [Citation(s) in RCA: 65] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
BACKGROUND Missing data are potentially an extensive problem in cost-effectiveness analyses conducted alongside randomised clinical trials, where prospective collection of both resource use and health outcome information is required. There are several possible reasons for the presence of incomplete records, and the validity of the analysis in the presence of data with missing values is dependent upon the mechanism generating the missing data phenomenon. In the past, the most commonly used methods for analysing datasets with incomplete observations were relatively ad hoc (e.g. case deletion, mean imputation) and suffered from potential limitations. Recently, several alternative and more sophisticated approaches (e.g. multiple imputation) have been proposed that attempt to correct the flaws of the simple imputation methods. OBJECTIVES The objectives are to provide a concise and accessible description of the quantitative methods most commonly used in trial-based cost-effectiveness analysis for handling missing data, and also to demonstrate the potential impact of these alternative approaches on the cost-effectiveness results reported in two case studies. METHODS Data from two recently conducted, trial-based economic evaluations are used to explore the sensitivity of the study results to the technique used to deal with incomplete observations. A statistical framework for representing the uncertainty in the alternative methods is outlined using an approach based on net benefits and cost-effectiveness acceptability curves. RESULTS The case studies demonstrate the potential importance of the approach used to handle missing data. Although the analytical strategy did not appear to alter the results of one of the studies, the other case study showed that that the results of the cost-effectiveness analysis were sensitive to both the decision to impute and also the imputation strategy adopted. CONCLUSIONS Analysts should be more explicit in reporting the analytical strategies applied in the presence of missing data. The use of a multiple imputation approach is recommended in the majority of cases, so as to adequately reflect the uncertainty in the study results due to the presence of missing data.
Collapse
Affiliation(s)
- Andrea Manca
- Centre for Health Economics, University of York, York, UK.
| | | |
Collapse
|
12
|
Hollen PJ, Gralla RJ, Rittenberg CN. Quality of life as a clinical trial endpoint: determining the appropriate interval for repeated assessments in patients with advanced lung cancer. Support Care Cancer 2004; 12:767-73. [PMID: 15206013 DOI: 10.1007/s00520-004-0639-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
One of the unresolved design issues for clinical trials with quality of life (QOL) as an endpoint is the frequency of measurement in patients with stage III and IV lung cancer. In a retrospective review of clinical trials, the QOL interval varied widely from 1 to 12 weeks during treatment. During follow-up, the interval was generally 2 to 3 months or not at all. The purpose of this methodological study was to determine an appropriate interval for QOL serial measurement based on prospectively collected data. The 20 patients for this study were part of a phase I/I study using combination chemotherapy in patients with advanced non-small cell lung cancer (NSCLC). They were typical of patients in lung cancer clinical trials, with a median age of 67 (interquartile range: 58, 72) years, the majority were male (13, 65%), and a baseline median Karnofsky performance status was 80 (interquartile range: 70%, 90%). The primary instrument, developed in 1985, was the Lung Cancer Symptom Scale (LCSS) patient form, a 9-item self-report and site-specific QOL measure. The method, outcome, and implication of these findings to research are presented for establishing a method for obtaining an appropriate serial measurement interval for QOL during therapy in clinical trials. Based on the findings of this study, an every 3-week QOL assessment for patients with advanced NSCLC provides data similar to more frequent evaluation (94% of data preserved compared to twice-weekly assessment, 95% confidence interval, 86-98%, p=0.05). Less frequent assessment (every 4 or every 6 weeks) retained less than 85% of the data, which is the recommended minimum adequacy rate. Retaining a high percentage of QOL information may lessen the effect of measurement bias due to patient attrition and may give more validity to QOL studies.
Collapse
Affiliation(s)
- Patricia J Hollen
- University of Virginia, McLeod Hall, Charlottesville, VA 22908-0782, USA.
| | | | | |
Collapse
|
13
|
Cella D, Peterman A, Hudgens S, Webster K, Socinski MA. Measuring the side effects of taxane therapy in oncology: the functional assesment of cancer therapy-taxane (FACT-taxane). Cancer 2003; 98:822-31. [PMID: 12910528 DOI: 10.1002/cncr.11578] [Citation(s) in RCA: 200] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND Cancer chemotherapy with some of the taxane class of agents can be associated with significant neurotoxicity, arthralgias, myalgias, and skin changes that may offset the therapeutic benefits of taxane use. METHODS The authors developed and tested a set of questions to assess these important side effects of taxane therapy from the patient's perspective. The current study evaluated the taxane subscale of the Functional Assessment of Chronic Illness Therapy (FACIT) measurement system. Reliability, validity, and responsiveness to expected change were evaluated in the context of an ongoing clinical trial comparing four cycles of carboplatin plus paclitaxel with a strategy of carboplatin plus paclitaxel until disease progression in patients with advanced nonsmall cell lung carcinoma (NSCLC). RESULTS The 16-item Taxane subscale score and the 11-item peripheral neuropathy subset both demonstrated excellent internal consistency and concurrent validity, and the scores worsened as one would predict during a 12-week treatment course of taxane therapy. Results of the psychometric analyses supported the use of this subscale for measuring the unwanted adverse consequences of effective cancer therapies. Measuring the patient perception of treatment side effects also allowed a preliminary exploration of the relative quality of life (QOL) impact of symptom relief and treatment toxicity. The results indicated that toxicity and symptom improvement may make relatively equivalent contributions to total QOL as measured by the summary score from a multidimensional QOL instrument, the Functional Assessment of Cancer Therapy-General. However, symptom status and improvement appear to play a stronger role than taxane toxicity in patients' global rating of their QOL. CONCLUSIONS Future research might examine this question of competing benefits as a potential aid to decision-making regarding the administration of toxic therapies in the setting of advanced disease.
Collapse
Affiliation(s)
- David Cella
- Center on Outcomes, Research and Education (CORE), Evanston Northwestern Healthcare, and Northwestern University, Evanston, Illinois 60201, USA.
| | | | | | | | | |
Collapse
|
14
|
Hahn EA, Glendenning GA, Sorensen MV, Hudgens SA, Druker BJ, Guilhot F, Larson RA, O'Brien SG, Dobrez DG, Hensley ML, Cella D. Quality of life in patients with newly diagnosed chronic phase chronic myeloid leukemia on imatinib versus interferon alfa plus low-dose cytarabine: results from the IRIS Study. J Clin Oncol 2003; 21:2138-46. [PMID: 12775739 DOI: 10.1200/jco.2003.12.154] [Citation(s) in RCA: 158] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Quality of life (QOL) outcomes in patients with chronic myeloid leukemia (CML) were evaluated in an international phase III study. PATIENTS AND METHODS Newly diagnosed patients with chronic phase CML were randomly assigned to imatinib or interferon alfa plus subcutaneous low-dose cytarabine (IFN+LDAC). Cross-over to the other treatment was permitted because of intolerance or lack of efficacy. Patients completed cancer-specific QOL (Functional Assessment of Cancer Therapy-Biologic Response Modifiers) and utility (Euro QoL-5D) questionnaires at baseline and during treatment (n = 1,049). The primary QOL end point was the Trial Outcome Index (TOI; a measure of physical function and well-being). Secondary end points included social and family well-being (SFWB), emotional well-being (EWB), and the utility score. Primary analyses were intention to treat with secondary analyses accounting for cross-over. RESULTS Patients receiving IFN+LDAC experienced a large decline in the TOI, whereas those receiving imatinib maintained their baseline level. Treatment differences at each visit were significant (P <.001) and clinically relevant in favor of imatinib. Mean SFWB, EWB, and utility scores were also significantly better for those patients taking imatinib. Patients who crossed over to imatinib experienced a large increase in TOI; significant (P <.001) differences were observed between patients who did and did not cross over in favor of imatinib. CONCLUSION Imatinib offers clear QOL advantages compared with IFN+LDAC as first-line treatment of chronic phase CML. In addition, patients who cross over to imatinib from IFN+LDAC experience a significant improvement in QOL compared with patients who continue to take IFN+LDAC.
Collapse
Affiliation(s)
- Elizabeth A Hahn
- Center on Outcomes, Research and Education, Evanston Northwestern Healthcare, 1001 University Pl, Ste 100, Evanston, IL 60201, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
15
|
Bottomley A, Vanvoorden V, Flechtner H, Therasse P. The challenges and achievements involved in implementing Quality of Life research in cancer clinical trials. Eur J Cancer 2003; 39:275-85. [PMID: 12565977 DOI: 10.1016/s0959-8049(02)00729-3] [Citation(s) in RCA: 52] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Over the last decade, Quality of Life (QOL) research has become an important aspect of cancer clinical trials. A dramatically increasing number of published studies, both randomised and non-randomised, report QOL outcomes. There is increasing evidence that QOL results impact on both future research and treatment decisions for clinicians. The rising number of studies with QOL components is mirrored within the European Organization for Research and Treatment of Cancer (EORTC), one of the largest cancer clinical trial organisations in Europe. Clinical trial groups have frequently reported on the difficulties and challenges of implementing QOL research. In the following paper, we therefore examine past experience in EORTC QOL studies, with a focus on the challenges presented and the improved approaches that are being implemented to obtain more meaningful outcomes.
Collapse
Affiliation(s)
- A Bottomley
- Quality of Life Unit, on behalf of the EORTC Quality of Life Group and the EORTC Data Center, EORTC Data Center, Avenue E. Mounier 83/11, 1200, Brussels, Belgium. abo@eortc@be
| | | | | | | |
Collapse
|
16
|
Wright EP, Selby PJ, Crawford M, Gillibrand A, Johnston C, Perren TJ, Rush R, Smith A, Velikova G, Watson K, Gould A, Cull A. Feasibility and compliance of automated measurement of quality of life in oncology practice. J Clin Oncol 2003; 21:374-82. [PMID: 12525532 DOI: 10.1200/jco.2003.11.044] [Citation(s) in RCA: 97] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Systematic quality-of-life (QOL) assessment may have value in oncology practice by increasing awareness of a wide range of issues, possibly increasing detection of psychologic morbidity, social problems, and changes in physical status, and improving care and its outcomes. However, logistic problems are substantial. Automated systems solve many of these problems. We field-tested the feasibility and compliance that can be achieved using a computer touchscreen system in two consecutive studies. PATIENTS AND METHODS In study 1, a prospective cohort of 272 patients was offered QOL assessment at each clinic appointment for 6 months. In study 2, all patients (N = 1,291) were offered QOL assessment as part of clinic routine during a 12-week period. RESULTS In study 1, 82% of patients agreed to take part, but over time, compliance was poor (median, 40%; mean, 43%) and deteriorated with longer follow-up. In study 2, the overall compliance was greatly increased (median, 100%; mean, 70%), and compliance was retained over multiple visits. In study 1, compliance was better in younger patients, males, and socially advantaged patients, but was not affected by the presence of depression or anxiety, or QOL. In the second study, building on experience in the first study, data collection and storage in the computer system was excellent, achieving 98% of collected data stored in one center. In general, patients were comfortable with the computers and the approach. Data collection on the wards was more difficult and less complete than in clinics, especially for patients undergoing acute admissions. CONCLUSION Feasibility with higher compliance was demonstrated in study 2, in which the data collection was integrated into routine care, and can be improved with further technical initiatives and education of staff.
Collapse
Affiliation(s)
- E P Wright
- Cancer Research UK, Clinical Centre in Leeds, St James's University Hospital, University of Leeds, Leeds, UK.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
17
|
Moinpour CM, Lyons B, Grevstad PK, Lovato LC, Crowley J, Czaplicki K, Buckner ZM, Ganz PA, Kelly K, Gandara DR. Quality of life in advanced non-small-cell lung cancer: results of a Southwest Oncology Group randomized trial. Qual Life Res 2002; 11:115-26. [PMID: 12018735 DOI: 10.1023/a:1015048908822] [Citation(s) in RCA: 39] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
PURPOSE The main purpose of this paper is to present the results of a randomized trial comparing the effects of two chemotherapy regimens on the Quality of life (QOL) of patients with advanced non-small-cell lung cancer (NSCLC). Trials in advanced stage disease represent an important treatment context for QOL assessment. A second purpose of this paper is to examine methods for handling the level of missing data commonly observed in the advanced stage disease context. METHODS Patients were randomized to receive cisplatin plus vinorelbine or carboplatin plus paclitaxel. The QOL of 222 patients was assessed with the Functional Assessment of Cancer Therapy-Lung (FACT-L) prior to randomization; follow-up assessments occurred at 13 and 25 weeks. Three methods were used to analyze the QOL data: (1) cross-sectional analysis of four patient categories (improved, stable, missing, and declined) based on changes in the FACT-L score, (2) a mixed linear model, and (3) a pattern mixture model. The longitudinal analyses addressed two potential data biases. RESULTS Questionnaire submission rates were 91% at baseline, 68% at 13 weeks, and 47% at 25 weeks. The cross-sectional and mixed linear model analyses did not show significant differences by treatment arm in patient-reported QOL. The pattern mixture model analysis, more appropriate given non-ignorable missing data, also found no statistically significant effect of treatment on patient QOL. CONCLUSION We present a sensitivity analysis approach with multiple methods for analyzing treatment effects on patient QOL in the presence of substantial, non-ignorable missing data in an advanced stage disease clinical trial. We conclude that the two treatment arms did not differ statistically in their effects on patient QOL over a 25-week treatment period.
Collapse
Affiliation(s)
- C M Moinpour
- Southwest Oncology Group Statistical Center, Fred Hutchinson Cancer Research Center, Seattle, WA 98109-1024, USA.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Morioka M, Kobayashi T, Furukawa Y, Jo Y, Shinkai M, Matsuki T, Yamamoto T, Tanaka H. Prostate-specific antigen levels and prognosis in patients with hormone-refractory prostate cancer treated with low-dose dexamethasone. Urol Int 2002; 68:10-5. [PMID: 11803262 DOI: 10.1159/000048411] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
OBJECTIVE The efficacy of low-dose dexamethasone (DXM) therapy in patients with hormone-refractory prostate cancer (HRPC) was evaluated. PATIENTS AND METHODS Prostate-specific antigen (PSA) response and survival following DXM therapy were analyzed in 27 Japanese patients exhibiting HRPC. Concurrent therapies and antiandrogen withdrawal syndrome, which may affect PSA levels and palliative effects, were excluded from the study. A dose of 1.5 mg of DXM was administered, and androgen deprivation therapy was maintained during DXM therapy. A decline in PSA levels of at least 50% from baseline was considered a significant PSA response. Prognostic factors for PSA response and survival were examined by univariate and multivariate analyses. RESULTS A significant PSA response was observed in 16 of the 27 cases (59.3%). Median survival period of patients exhibiting significant PSA response was 15.9 months and was significantly longer than that of patients demonstrating a decline in PSA of less than 50% (median 7.7 months, p < 0.0001). Effect on pain control also correlated with the significant PSA response. No meaningful prognostic factors for PSA response were detected; however, a PSA decline of greater than 50% was the prognostic factor for survival. CONCLUSION DXM therapy remains one of the most beneficial treatment modalities in patients with HRPC.
Collapse
Affiliation(s)
- Masaaki Morioka
- Department of Urology, Kawasaki Medical School, Kurashiki, Japan.
| | | | | | | | | | | | | | | |
Collapse
|
19
|
Janni W, Rjosk D, Dimpfl TH, Haertl K, Strobl B, Hepp F, Hanke A, Bergauer F, Sommer H. Quality of life influenced by primary surgical treatment for stage I-III breast cancer-long-term follow-up of a matched-pair analysis. Ann Surg Oncol 2001; 8:542-8. [PMID: 11456055 DOI: 10.1007/s10434-001-0542-2] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
BACKGROUND Breast-conserving therapy has been demonstrated to be just as safe and a less disruptive experience compared with mastectomy for surgically manageable breast cancer. There is, however, no agreement in the literature about the impact of these procedures on several important aspects of quality of life (QOL). The purpose of the present study is to compare the long-term impact of these two surgical approaches on QOL in patients with identical tumor stages and to suggest possible shortcomings of the standard QOL questionnaires. METHOD Between August 1999 and May 2000, QOL questionnaires were answered by 152 pair-matched patients at the I. Frauenklinik, Ludwig-Maximilians University Munich, as part of routine follow-up examinations. The pairs of patients, each consisting of one patient after mastectomy and one after breast conservation, were selected according to the highest degree of equivalence in tumor stage. All patients had been initially treated for stage I-III breast cancer without evidence of distant metastases. The QOL was evaluated by using the QLQ-C30 questionnaire version 2.0 of the EORTC Study Group on Quality of Life. We formulated seven additional questions about the patients' satisfaction with the primary surgical treatment modality as viewed from their current perspective. The QOL questionnaires were answered after a median interval of 46 months following primary treatment. RESULTS Tumor stage, prognostic factors, and adjuvant systemic treatment were well balanced between the two groups. No differences between the two groups were observed in terms of all QOL items measured by the QLQ-C30. Our additional questions, however, revealed that patients in the mastectomy group were less satisfied with the cosmetic result of their primary operation (P < .0001), were more likely to feel basic changes in their appearance (P < .0001), and were more likely to be emotionally stressed by these facts (P < .0001). From their perspective at the time of completing the questionnaires, 11 patients in the mastectomy group (15%) would decide differently about the surgical treatment modality, compared with only 3 patients (4%) in the breast conservation group (P = .025). CONCLUSION While the primary surgical treatment modality seems to have no long-term impact on general QOL, certain body-image-related problems may be caused by mastectomy. Standard measuring instruments for QOL may fail to detect differences in satisfaction and adaptation with the primary surgical treatment modality.
Collapse
Affiliation(s)
- W Janni
- Department of Gynecology and Obstetrics, Women's Clinic at Ludwig-Maximilians-University, Munich, Germany.
| | | | | | | | | | | | | | | | | |
Collapse
|
20
|
Macquart-Moulin G, Viens P, Palangié T, Bouscary ML, Delozier T, Roché H, Janvier M, Fabbro M, Moatti JP. High-dose sequential chemotherapy with recombinant granulocyte colony-stimulating factor and repeated stem-cell support for inflammatory breast cancer patients: does impact on quality of life jeopardize feasibility and acceptability of treatment? J Clin Oncol 2000; 18:754-64. [PMID: 10673516 DOI: 10.1200/jco.2000.18.4.754] [Citation(s) in RCA: 45] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE This study was designed to investigate the quality of life (QOL) of patients enrolled onto the High-Dose Chemotherapy for Breast Cancer Study Group trial (PEGASE 02), a French pilot multicenter trial of the treatment of inflammatory breast cancer (IBC) aimed at evaluating (1) toxicity and feasibility of sequential high-dose chemotherapy (HDC) with recombinant human granulocyte colony-stimulating factor (filgrastim) and stem-cell support and (2) response to HDC in terms of pathologic response and survival. PATIENTS AND METHODS QOL measures were performed at inclusion and four times subsequently up to 1 year using an ad hoc side-effect questionnaire (19 physical symptoms) and the European Organization for Research and Treatment of Cancer Quality-of-Life Questionnaire (EORTC QLQ-C30). RESULTS Of the 95 patients entered, the overall QOL questionnaire completion compliance was 75.6%. During cycle 3 of HDC, the number of symptoms was high (mean +/- SD QOL score, 10 +/- 3), with fatigue, hair loss, appetite loss, nausea, change in taste, vomiting, fever, and weight loss reported by more than 60% of patients. Toxicity and distress associated with HDC were reflected in the decline of four EORTC QLQ-C30 scores: global QOL (P =.001), and physical, role, and social functioning (P <.001 for all statistics). However, QOL deterioration disappeared after treatment completion, except for physical functioning (P =.025). One year after inclusion, most QOL scores returned to baseline, and both emotional functioning and global QOL scores were even higher than baseline (P =.030 and P =.009, respectively). CONCLUSION If it is confirmed that improvements in pathologic response rates with HDC effectively translate into increased probabilities of survival for IBC patients, adoption of such treatment as PEGASE 02 will not involve crucial choices between length of life and QOL and should not be delayed for QOL arguments.
Collapse
Affiliation(s)
- G Macquart-Moulin
- National Institute of Health and Medical Research Unit 379, Institut Paoli-Calmettes, Marseilles, France.
| | | | | | | | | | | | | | | | | |
Collapse
|
21
|
Cheng JD, Hitt J, Koczwara B, Schulman KA, Burnett CB, Gaskin DJ, Rowland JH, Meropol NJ. Impact of quality of life on patient expectations regarding phase I clinical trials. J Clin Oncol 2000; 18:421-8. [PMID: 10637258 DOI: 10.1200/jco.2000.18.2.421] [Citation(s) in RCA: 96] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Quality of life (QOL) is increasingly recognized as a critical cancer-treatment outcome measure, but little is known about the impact of QOL on the patient decision-making process. A pilot study was conducted in an effort to (1) measure the expectations of patients, physicians, and research nurses regarding the potential benefits and toxicities from experimental and standard therapies, and (2) determine the relationship of QOL to patient perceptions regarding treatment options. METHODS Thirty cancer patients enrolling in phase I clinical trials, their physicians, and their research nurses were administered questionnaires that assessed demographics, QOL, and treatment expectations. RESULTS Compared with their physicians, patients overestimated potential benefits and toxicities from experimental therapy (mean expected benefit, 59.8% v 23.8%, P <.01; mean expected toxicity, 29.8% v 16.0%, P <.01). Patients estimated a greater potential for benefit (59.8% v 36.8%, P <.01) and less potential for toxicity (29.8% v 45.6%, P =.01) for experimental therapy, compared with standard therapy. Short Form-36 general health perception correlated with patient perception of potential benefit from experimental therapy (r =.48, P =.01). CONCLUSION Participants in phase I clinical trial have high expectations regarding the success of experimental therapy and discount potential toxicity. Patient QOL may affect the expectation of benefit from experimental therapy and, ultimately, treatment choice. Understanding the interactions between QOL and patient expectations may guide the development of improved strategies to present appropriate information to patients considering early-phase clinical trials.
Collapse
Affiliation(s)
- J D Cheng
- Department of Medicine, Roswell Park Cancer Institute, Buffalo, NY, USA
| | | | | | | | | | | | | | | |
Collapse
|