1
|
Seo C, Hu S, King-Kallimanis BL, Chang AE, Regnault A, Miller AS, Kaur MN. Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review. Qual Life Res 2025:10.1007/s11136-025-03964-5. [PMID: 40279025 DOI: 10.1007/s11136-025-03964-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/24/2025] [Indexed: 04/26/2025]
Abstract
PURPOSE Qualitative data that reflects patients' experiences are the foundation of any patient-reported outcome measure (PROM) development and validation study; however, there is limited understanding of the type of data visualization techniques that facilitate communication of this data. The goal of this targeted literature review was to investigate data visualization methods that have been used in published PROM development and validation literature to report qualitative results. METHODS A literature search in OVID via MEDLINE was conducted among the top 10 non-disease-specific journals publishing PROM qualitative development and validation studies. Studies that reported qualitative methods to develop/validate a PROM and included data visualization in the form of tables or figures were included. Article characteristics and data visualization types were extracted. RESULTS A total of 185 articles were included in data extraction. Most articles (n = 109, 59.1%) included figures (n = 172, average 2 relevant figures per article) in the form of hierarchy/flowcharts (n = 124, 72.1%) and bar charts (n = 29, 16.9%). Information reported in figures included depiction of conceptual frameworks (n = 112, 65.1%) and concept frequency (n = 40, 24.4%). Most articles (n = 152, 81.7%) included tables (n = 307, average 2 relevant tables per article). Information reported in tables included concept frequency (n = 133, 43.3%) and cognitive debriefing and revisions (n = 91, 29.6%). CONCLUSION Data visualization techniques used to report qualitative results in the identified PROM qualitative development and validation studies were heterogeneous, and many studies did not utilize any data visualization techniques. This study will inform the development of guidance for using data visualizations to report qualitative PROM research.
Collapse
Affiliation(s)
- Caroline Seo
- BioPharmaceuticals Medical Evidence, AstraZeneca, Gaithersburg, MD, USA.
| | - Sophia Hu
- Patient-Reported Outcomes, Value, and Experience (PROVE) Center, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | | | - Ashley E Chang
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | | | - Amitai S Miller
- Patient-Reported Outcomes, Value, and Experience (PROVE) Center, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Manraj N Kaur
- Patient-Reported Outcomes, Value, and Experience (PROVE) Center, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| |
Collapse
|
2
|
Fleckner J, Barker C. The 2009 FDA PRO guidance, Potential Type I error, Descriptive Statistics and Pragmatic estimation of the number of interviews for item elicitation. J Biopharm Stat 2024:1-16. [PMID: 39582199 DOI: 10.1080/10543406.2024.2420642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 10/17/2024] [Indexed: 11/26/2024]
Abstract
A statistical methodology named "capture recapture", a Kaplan-Meier Summary Statistic, and an urn model framework are presented to describe the elicitation, then estimate both the number of interviews and the total number of items ("codes") that will be elicited during patient interviews, and present a summary graphical statistic that "saturation" has occurred. This methodology is developed to address a gap in the FDA 2009 PRO and 2012 PFDD guidance for determining the number of interviews (sample size). This estimate of the number of interviews (sample size) uses a two-step procedure. The estimate of the total number of items is then used to estimate the number of interviews to elicit all items. A framework called an urn model is a framework for describing the elicitation and demonstrate the algorithm for declaring saturation "first interview with zero new codes". A caveat emptor is that due to independence assumptions, the urn model is not used as a method for estimating probabilities. The URN model provides a framework to demonstrate that an algorithm such as "first interview with zero new codes" may establish that all codes have been elicited. The limitations of the Urn model, capture recapture, and Kaplan-Meier are summarized. The statistical methods and the estimates supplement but do not replace expert judgement and declaration of "saturation." A graphical summary statistic is presented to summarize "saturation," after expert declaration for two algorithms. An example of a capture-recapture estimate, using simulated data is provided. The example suggests that the estimate of total number of codes may be accurate when prepared as early as the second interview. A second simulation is presented with an URN model, under a strong assumption of independence that an algorithm such as 'first interview with zero new codes" may fail to identify all codes. Potential errors in declaration of saturation are presented. Recommendations are presented for additional research and the use of the algorithm "first interview with zero new codes."
Collapse
Affiliation(s)
- Josh Fleckner
- Department of Statistics and Data Science, Evanston, Illinois, USA
| | - Chris Barker
- Chris Barker Statistical Planning and Analysis Services Inc, Napa, California, USA
| |
Collapse
|
3
|
Effectiveness of Virtual Reality Vs Guides imagery on mood changes in cancer patients receiving chemotherapy treatment: A crossover trial. Eur J Oncol Nurs 2022; 61:102188. [DOI: 10.1016/j.ejon.2022.102188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 07/30/2022] [Accepted: 08/02/2022] [Indexed: 11/19/2022]
|
4
|
Johnstone PAS, Alla R, Yu HHM, Portman D, Cheng H, Mitchell R, Jim H. Patient-reported outcomes: using ESAS to screen for anemia. Support Care Cancer 2019; 28:4141-4145. [PMID: 31872297 DOI: 10.1007/s00520-019-05238-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 12/09/2019] [Indexed: 10/25/2022]
Abstract
PURPOSE Patient perspectives of their symptom burden provide valuable data to clinicians. We have investigated the Edmonton Symptom Assessment Scale (ESAS) extensively in our radiation oncology and supportive care clinics. We were interested in examining whether ESAS data could correlate with anemia. METHODS Our clinics have used a modified ESAS since 2015; patients now input data directly into the electronic medical record using a tablet interface. Of 9813 patients providing ESAS reports, we retrieved hemoglobin (Hb) data from 8304. Of these, 1351 patients had both performed on the same day. Anemia existed if Hb was < 13.0 g/L (man) or < 12 g/L (woman). RESULTS When self-reported scores for both tiredness and shortness of breath were 7 and above, the positive predictive value (PPV) for anemia was 80%, and specificity was 97.6%. Corresponding sensitivity was 8.2% and accuracy was 48.9%. This 2-item model could be a valuable screening tool for lack of anemia in cancer patients in the outpatient setting: if patients rate both these ESAS items < 7, there exists < 3% false positive risk. An expanded 5-item model adding lack of appetite, pain, and bone marrow primary site increased sensitivity and accuracy at the expense of specificity and PPV. We consider this less clinically functional than the two-item screen. CONCLUSION This is one of the first reports of PRO data screening for a clinical sign, in this case, anemia. Predicting freedom from anemia is feasible using 2 ESAS survey questions: tiredness and shortness of breath.
Collapse
Affiliation(s)
- Peter A S Johnstone
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, 12902 Magnolia Drive, Tampa, FL, 33612, USA. .,Department of Health Outcomes & Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, USA.
| | - Raviteja Alla
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, 12902 Magnolia Drive, Tampa, FL, 33612, USA
| | - Hsiang-Hsuan Michael Yu
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, 12902 Magnolia Drive, Tampa, FL, 33612, USA
| | - Diane Portman
- Department of Supportive Care, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, USA
| | - Hing Cheng
- PE Research Consulting Ltd, Calgary, AB, Canada
| | - Ross Mitchell
- Department of Biostatistics and Bioinformatics, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, USA
| | - Heather Jim
- Department of Health Outcomes & Behavior, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, USA
| |
Collapse
|
5
|
Nunes MM, Lopes MVDO, da Silva VM, Leandro TA, Fróes NBM, Almeida ADAP, Sobreira BA, Nunes VM, de Menezes AP, Ferreira GDL. Validation of Clinical Indicators of the Nursing Diagnosis of Ineffective Protection in Adolescents With Cancer. J Pediatr Nurs 2018; 42:e58-e65. [PMID: 29779762 DOI: 10.1016/j.pedn.2018.05.001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2017] [Revised: 05/04/2018] [Accepted: 05/04/2018] [Indexed: 12/23/2022]
Abstract
PURPOSE To validate the clinical indicators of the nursing diagnosis of Ineffective protection in adolescents with cancer based on diagnostic accuracy measurements. DESIGN AND METHODS Measurements of sensitivity and specificity for the indicators were calculated using latent class analysis with random effects in a sample of 127 adolescents between 10 and 19 years of age. RESULTS The prevalence of diagnosis was estimated at 93.7%. The indicators deficient immunity and weakness showed higher sensitivity values, whereas opportunistic infections, recurrent infections, insomnia, mucosal lesions, and coughing showed high specificity. CONCLUSIONS Seven indicators were clinically validated. PRACTICE IMPLICATIONS The validation of clinical indicators provides nurses with the knowledge of useful signs and symptoms to identify early spectra of a nursing diagnosis or confirm their presence in a specific population. In clinical practice, this knowledge contributes to an accurate diagnostic inference and the planning of nursing interventions directed to the idiosyncrasies of individuals.
Collapse
|
6
|
Cortinovis D, Beretta G, Piazza E, Luchena G, Aglione S, Bertolini A, Buzzoni R, Cabiddu M, Carnaghi C, Danova M, Farina G, Ferrari V, Frascaroli M, Reni M, Tansini G. Chemotherapy-Induced Anemia and Oncologist Perception on Treatment: Results of a Web-Based Survey. TUMORI JOURNAL 2018; 99:45-50. [DOI: 10.1177/030089161309900108] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Aims and background Anemia prevalence and incidence in chemotherapy-treated patients is high. Erythropoiesis-stimulating agents (ESAs) are frequently employed in the management of chemotherapy-induced anemia. However, other treatments such as red blood transfusion or iron supplementation are normally used. Recent international guidelines raised some concern about ESAs employment with a possible impact in chemotherapy-induced anemia management and changes in clinical practice behavior. Methods To evaluate opinions about chemotherapy-induced anemia clinical management preference, the Associazione Italiana Oncologia Medica (AIOM) Lombardy section coordinators sent via email a 12-item questionnaire about their knowledge on CIA and usual therapeutic strategies to manage this adverse event to AIOM Lombardy onco-hematologist members. Results From January 2011 to March 2011, 81 questionnaires were collected with an approximated share of 30%. The survey was completed mainly by oncologists (91%) aged 35–50 years (50%). Chemotherapy-induced anemia was considered to have clinical impact in changing cancer therapeutic strategy by nearly 60% of the respondents. ESAs were administered largely (80%) with concomitant iron supplementation in 52%; 38% jointly used blood transfusion as part of the therapy. Nearly 20% of those who replied correctly employed transferrin saturation levels as a marker to guide iron supplementation. Physician prescribers strictly followed the guidelines to start and stop ESAs even if 14% were negatively influenced by new ASCO recommendations. ESA biosimilars were considered future substitutes of originators in 45% of the cases. Conclusions Chemotherapy-induced anemia was perceived as an adverse event with a mild impact on clinical practice. ESAs were largely employed, however the number of transfusions and lack of employment of markers of iron depletion suggested that adherence to guidelines could be theoretically met but with some discordances regarding the most appropriate strategies in daily clinical practice.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Roberto Buzzoni
- DH & Terapia Ambulatoriale Oncologica, Fondazione IRCCS Istituto Nazionale Tumori, Milan
| | - Mary Cabiddu
- Oncologia Medica, Ospedale Treviglio-Caravaggio, Bergamo
| | - Carlo Carnaghi
- Oncologia Medica, Humanitas Mater Domini, Castellanza (VA), Onco-Ematologia, Humanitas Cancer Center, Rozzano (MI)
| | - Marco Danova
- Medicina oncologica, Ospedale Civile, Vigevano (PV)
| | | | | | | | | | | |
Collapse
|
7
|
Symptom Clusters in Korean Patients With Metastatic Cancer Undergoing Palliative Chemotherapy. J Hosp Palliat Nurs 2016. [DOI: 10.1097/njh.0000000000000240] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
8
|
Engaging Patients as Partners in Developing Patient-Reported Outcome Measures in Cancer—A Review of the Literature. Support Care Cancer 2016; 24:3543-9. [DOI: 10.1007/s00520-016-3151-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2015] [Accepted: 03/07/2016] [Indexed: 11/24/2022]
|
9
|
Gnanasakthy A, DeMuro C. Overcoming Organizational Challenges of Integrating Patient-Reported Outcomes in Oncology Clinical Trials. Ther Innov Regul Sci 2015; 49:822-830. [PMID: 30222383 DOI: 10.1177/2168479015608413] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Patients with cancer frequently experience multiple symptoms that may cause significant distress and may impair physical, emotional, and social functioning and health-related quality of life. Drug development in oncology is characterized by a high attrition rate of new compounds, faster development times encouraged by the regulatory process, studies that are often open and single-arm, and emphasis on survival-related endpoints, creating unique challenges for the inclusion of patient reported outcomes (PROs). These challenges to include PRO-related endpoints in oncology research are further exacerbated by downward pressure on budget and resources and also an overly rigorous application of the US Food and Drug Administration's PRO guidance, which can in turn prevent study teams from optimally including PROs in oncology clinical trials. With increasing calls for demonstration of value of new cancer drugs from payers, patients, and their caregivers, study teams should consider the utility of PROs beyond regulatory needs. Optimal implementation of a PRO strategy in oncology research can be achieved by applying the PRO guidance to the greatest extent possible, making use of off-the-shelf PRO measures to capture concepts of interest, discussing plans with the regulatory bodies early in the process, and treating PRO-related endpoints with the same level of rigor as other endpoints.
Collapse
Affiliation(s)
| | - Carla DeMuro
- 1 RTI Health Solutions, Research Triangle Park, NC, USA
| |
Collapse
|
10
|
Vansteenkiste J, Wauters I, Elliott S, Glaspy J, Hedenus M. Chemotherapy-induced anemia: the story of darbepoetin alfa. Curr Med Res Opin 2013; 29:325-37. [PMID: 23323876 DOI: 10.1185/03007995.2013.766593] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
BACKGROUND Prior to the approval of the first erythropoiesis-stimulating agent (ESA) in the early 1990s, red blood cell transfusions were the primary means of treating severe chemotherapy-induced anemia (CIA), with little recourse for those with more mild forms of the condition. The introduction of the ESAs allowed treatment of mild-to-moderate CIA in patients with cancer. It has been a decade since darbepoetin alfa (DA), a second-generation ESA with a longer half-life, became available to patients with CIA. OBJECTIVE AND METHODS We present a review of studies on DA in CIA, from its development through to the present day. Medline was searched for randomized clinical trials on DA. Additional trials and meta-analyses on ESAs were incorporated into this review when relevant. RESULTS The first publications on DA generally focused on optimal dosing, efficacy and tolerability. In these, it was shown that DA is an effective and well tolerated treatment option to achieve hematopoietic response, regardless of dosing interval. Subsequently, the focus shifted towards meta-analyses on survival data of all ESAs. These reported conflicting results regarding mortality and/or disease progression. However, guidelines for ESA use were updated and, when followed, these make ESAs a well tolerated and effective tool for managing CIA. CONCLUSIONS As the past decade has broadened our knowledge on the benefits and risks of CIA management, continued high-quality studies will help to optimize treatment with ESAs in order to maximize quality of life for these patients. The limitation of a literature review of this nature is the complete reliance on previously published research and the availability of these studies using the methodology outlined above.
Collapse
Affiliation(s)
- Johan Vansteenkiste
- Respiratory Oncology Unit (Pulmonology), University Hospital Gasthuisberg, Leuven, Belgium.
| | | | | | | | | |
Collapse
|