1
|
Oh IS, Jeong HE, Lee H, Filion KB, Noh Y, Shin JY. Validating an approach to overcome the immeasurable time bias in cohort studies: a real-world example and Monte Carlo simulation study. Int J Epidemiol 2023; 52:1534-1544. [PMID: 37172269 DOI: 10.1093/ije/dyad049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 02/03/2023] [Accepted: 04/18/2023] [Indexed: 05/14/2023] Open
Abstract
BACKGROUND Immeasurable time bias arises from the lack of in-hospital medication information. It has been suggested that time-varying adjustment for hospitalization may minimize this potential bias. However, whereas we examined this issue in one case study, there remains a need to assess the validity of this approach in other settings. METHODS Using a Monte Carlo simulation, we generated synthetic immeasurable time-varying hospitalization-related factors of duration, frequency and timing. Nine scenarios were created by combining three frequency scenarios and three duration scenarios, where the empirical cohort distribution of hospitalization was used to simulate the 'timing'. We used Korea's healthcare database and a case example of β-blocker use and mortality among patients with heart failure. We estimated the gold-standard hazard ratio (HR) with 95% CI using inpatient and outpatient drug data, and that of the pseudo-outpatient setting using outpatient data only. We assessed the validity of adjusting for time-varying hospitalization in nine different scenarios, using relative bias, confidence limit ratio (CLR) and mean squared error (MSE) compared with the empirical gold-standard estimate across bootstrap resamples. RESULTS With the real-world gold standard (HR 0.73; 95% CI 0.67-0.80) as the reference estimate, adjusting for time-varying hospitalization (0.71; 0.63-0.80) effectively reduced the immeasurable time bias and had the following performance metrics across the nine scenarios: relative bias (range: -7.08% to 0.61%), CLR (1.28 to 1.36) and MSE (0.0005 to 0.0031). CONCLUSIONS The approach of adjusting for time-varying hospitalization consistently reduced the immeasurable time bias in Monte Carlo simulated data.
Collapse
Affiliation(s)
- In-Sun Oh
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada
- Centre for Clinical Epidemiology, Lady Davis Research Institute-Jewish General Hospital, Montreal, Quebec, Canada
| | - Han Eol Jeong
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
| | - Hyesung Lee
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
| | - Kristian B Filion
- Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada
- Centre for Clinical Epidemiology, Lady Davis Research Institute-Jewish General Hospital, Montreal, Quebec, Canada
- Department of Medicine, McGill University, Montreal, Quebec, Canada
| | - Yunha Noh
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada
- Centre for Clinical Epidemiology, Lady Davis Research Institute-Jewish General Hospital, Montreal, Quebec, Canada
| | - Ju-Young Shin
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Biohealth Regulatory Science, Sungkyunkwan University, Suwon, Gyeonggi-do, South Korea
- Department of Clinical Research Design & Evaluation, Samsung Advanced Institute for Health Sciences and Technology, Sungkyunkwan University, Seoul, South Korea
| |
Collapse
|
2
|
Moon RJ, Reginster JY, Al-Daghri NM, Thiyagarajan JA, Beaudart C, Bruyère O, Burlet N, Chandran M, da Silva MC, Conaghan PG, Dere WH, Diez-Perez A, Hadji P, Halbout P, Hiligsmann M, Kanis JA, McCloskey EV, Ormarsdottir S, Prieto-Alhambra D, Radermecker RP, Rizzoli R, Al-Saleh Y, Silverman SL, Simon LS, Thomasius F, van Staa T, Laslop A, Cooper C, Harvey NC. Real-world evidence: new opportunities for osteoporosis research. Recommendations from a Working Group from the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO). Osteoporos Int 2023; 34:1283-1299. [PMID: 37351614 PMCID: PMC10382414 DOI: 10.1007/s00198-023-06827-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 04/28/2023] [Indexed: 06/24/2023]
Abstract
This narrative review summarises the recommendations of a Working Group of the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) for the conduct and reporting of real-world evidence studies with a focus on osteoporosis research. PURPOSE Vast amounts of data are routinely generated at every healthcare contact and activity, and there is increasing recognition that these real-world data can be analysed to generate scientific evidence. Real-world evidence (RWE) is increasingly used to delineate the natural history of disease, assess real-life drug effectiveness, understand adverse events and in health economic analysis. The aim of this work was to understand the benefits and limitations of this type of data and outline approaches to ensure that transparent and high-quality evidence is generated. METHODS A ESCEO Working Group was convened in December 2022 to discuss the applicability of RWE to osteoporosis research and approaches to best practice. RESULTS This narrative review summarises the agreed recommendations for the conduct and reporting of RWE studies with a focus on osteoporosis research. CONCLUSIONS It is imperative that research using real-world data is conducted to the highest standards with close attention to limitations and biases of these data, and with transparency at all stages of study design, data acquisition and curation, analysis and reporting to increase the trustworthiness of RWE study findings.
Collapse
Affiliation(s)
- Rebecca J Moon
- MRC Lifecourse Epidemiology Centre, University of Southampton, Southampton, SO16 6YD, UK
- Paediatric Endocrinology, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Jean-Yves Reginster
- WHO Collaborating Center for Epidemiology of Musculoskeletal Health and Ageing, Liège, Belgium
- Division of Epidemiology, Public Health and Health Economics, University of Liège, Liège, Belgium
| | - Nasser M Al-Daghri
- Biochemistry Department, College of Science, King Saud University, Riyadh, Saudi Arabia
| | | | - Charlotte Beaudart
- WHO Collaborating Center for Epidemiology of Musculoskeletal Health and Ageing, Liège, Belgium
- Division of Epidemiology, Public Health and Health Economics, University of Liège, Liège, Belgium
| | - Olivier Bruyère
- WHO Collaborating Center for Epidemiology of Musculoskeletal Health and Ageing, Liège, Belgium
- Division of Epidemiology, Public Health and Health Economics, University of Liège, Liège, Belgium
| | - Nansa Burlet
- Division of Epidemiology, Public Health and Health Economics, University of Liège, Liège, Belgium
| | - Manju Chandran
- Osteoporosis and Bone Metabolism Unit, Department of Endocrinology, Singapore General Hospital, Singapore, Singapore
| | | | - Philip G Conaghan
- Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds, Leeds, UK
- NIHR Leeds Musculoskeletal Biomedical Research Unit, Leeds, UK
| | - Willard H Dere
- Department of Internal Medicine, Utah Center for Clinical and Translational Science, University of Utah School of Medicine, Salt Lake City, UT, USA
| | - Adolfo Diez-Perez
- Department of Internal Medicine, Hospital del Mar-IMIM, Autonomous University of Barcelona and CIBERFES, Instituto Carlos III, Barcelona, Spain
| | - Peyman Hadji
- Frankfurt Centre for Bone Health, Frankfurt, Germany
- Philipps University of Marburg, Hesse, Germany
| | | | - Mickaël Hiligsmann
- Department of Health Services Research, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, the Netherlands
| | - John A Kanis
- Mary McKillop Institute for Health Research, Australian Catholic University, Melbourne, Australia
- Centre for Metabolic Bone Diseases, University of Sheffield, Sheffield, UK
| | - Eugene V McCloskey
- MRC Versus Arthritis Centre for Integrated Research in Musculoskeletal Ageing, University of Sheffield, Sheffield, UK
- Mellanby Centre for Musculoskeletal Research, Department of Oncology & Metabolism, University of Sheffield, Sheffield, UK
| | | | - Daniel Prieto-Alhambra
- Pharmaco- and Device Epidemiology, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences (NDORMS), University of Oxford, Oxford, UK
| | - Régis P Radermecker
- Department of Clinical Pharmacology, Diabetes, Nutrition and Metabolic Disorders, CHU Liege, Liege, Belgium
| | - René Rizzoli
- Geneva University Hospitals and Faculty of Medicine, Geneva, Switzerland
| | - Yousef Al-Saleh
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Medicine, King Abdulaziz Medical City, Riyadh, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| | | | | | | | - Tjeerd van Staa
- Centre for Health Informatics, University of Manchester, Manchester, UK
| | - Andrea Laslop
- Scientific Office, Austrian Medicines and Medical Devices Agency, Vienna, Austria
| | - Cyrus Cooper
- MRC Lifecourse Epidemiology Centre, University of Southampton, Southampton, SO16 6YD, UK
- NIHR Southampton Biomedical Research Centre, University of Southampton and University Hospital Southampton NHS Foundation Trust, Southampton, UK
- National Institute for Health Research (NIHR) Musculoskeletal Biomedical Research Centre, University of Oxford, Oxford, UK
| | - Nicholas C Harvey
- MRC Lifecourse Epidemiology Centre, University of Southampton, Southampton, SO16 6YD, UK.
- NIHR Southampton Biomedical Research Centre, University of Southampton and University Hospital Southampton NHS Foundation Trust, Southampton, UK.
| |
Collapse
|
3
|
Choi BK, Lee JS, Kim HR, Kim HS, Jung YH, Park YR. Bleeding risk and mortality according to antithrombotic agents' exposure in cancer-related stroke patients: nationwide population-based cohort study in South Korea. BMC Neurol 2023; 23:187. [PMID: 37161360 PMCID: PMC10169453 DOI: 10.1186/s12883-023-03208-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 04/14/2023] [Indexed: 05/11/2023] Open
Abstract
BACKGROUND Ischemic stroke with active cancer is thought to have a unique mechanism compared to conventional stroke etiologies. There is no gold standard guideline for secondary prevention in patients with cancer-related stroke, hence, adequate type of antithrombotic agent for treatment is controversial. METHODS Subjects who were enrolled in National Health Insurance System Customized Research data during the period between 2010 and 2015 were observed until 2019. Subject diagnosed with ischemic stroke within six months before and 12 months after a cancer diagnosis was defined as cancer-related stroke patient. To solve immeasurable time bias, the drug exposure evaluation was divided into daily units, and each person-day was classified as four groups: antiplatelet, anticoagulant, both types, and unexposed to antithrombotic drugs. To investigate bleeding risk and mortality, Cox proportional hazards regression model with time-dependent covariates were used. RESULTS Two thousand two hundred eighty-five subjects with cancer-related stroke were followed and analyzed. A group with anticoagulation showed high estimated hazard ratios (HRs) of all bleeding events compared to a group with antiplatelet (major bleeding HR, 1.35; 95% confidence interval [CI], 1.20-1.52; p < 0.001). And the result was also similar in the combination group (major bleeding HR, 1.54; 95% CI, 1.13-2.09; p = 0.006). The combination group also showed increased mortality HR compared to antiplatelet group (HR, 1.72; 95% CI, 1.47-2.00; p < 0.001). CONCLUSIONS Bleeding risk increased in the anticoagulant-exposed group compared to antiplatelet-exposed group in cancer-related stroke patients. Thus, this result should be considered when selecting a secondary prevention drug.
Collapse
Affiliation(s)
- Bo Kyu Choi
- Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Ji Sung Lee
- Clinical Research Center, Asan Medical Center, Asan Institute for Life Sciences, University of Ulsan College of Medicine, Seoul, 05505, Korea
| | - Hae Reong Kim
- Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Han Sang Kim
- Yonsei Cancer Center, Division of Medical Oncology, Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea
- Graduate School of Medical Science, Severance Biomedical Science Institute, Brain Korea 21 Project, Yonsei University College of Medicine, Seoul, Korea
| | - Yo Han Jung
- Department of Neurology, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul, Korea.
| | - Yu Rang Park
- Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
4
|
Jeong HE, Lee H, Oh IS, Filion KB, Shin JY. Immeasurable Time Bias in Self-controlled Designs: Case-crossover, Case-time-control, and Case-case-time-control Analyses. J Epidemiol 2023; 33:82-90. [PMID: 34053964 PMCID: PMC9794445 DOI: 10.2188/jea.je20210099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Impact of immeasurable time bias (IMTB) is yet to be examined in self-controlled designs. METHODS We conducted case-crossover, case-time-control, and case-case-time-control analyses using Korea's healthcare database. Two empirical examples among elderly patients were used: 1) benzodiazepines-hip fracture; 2) benzodiazepines-mortality. For cases, the date of hip fracture diagnosis or death was defined as the index date, and the inherited date of their matched cases for controls or future cases. Exposure was assessed in the 1-30 day (hazard) and 61-90 day (control) windows preceding the index date. A non-missing exposure setting included in- and outpatient prescriptions and the pseudo-outpatient setting included only the outpatients. Conditional logistic regression was done to estimate odds ratios (ORs) with 95% confidence intervals (CIs), where the relative difference in OR among the two settings was calculated to quantify the IMTB. RESULTS The IMTB had negligible impacts in the hip fracture example in the case-crossover (non-missing exposure setting OR 1.27; 95% CI, 1.12-1.44; pseudo-outpatient setting OR 1.21; 95% CI, 1.06-1.39; magnitude 0.05), case-time-control (OR 1.18; 95% CI, 0.98-1.44; OR 1.13; 95% CI, 0.92-1.38; 0.04, respectively), and case-case-time-control analyses (OR 0.99; 95% CI, 0.80-1.23; OR 0.94; 95% CI, 0.75-1.18; 0.05, respectively). In the mortality example, IMTB had significant impacts in the case-crossover (non-missing exposure setting OR 1.44; 95% CI, 1.36-1.52; pseudo-outpatient setting OR 0.72; 95% CI, 0.67-0.78; magnitude 1.00), case-time-control (OR 1.38; 95% CI, 1.26-1.51; OR 0.68; 95% CI, 0.61-0.76; 1.03, respectively), and case-case-time-control analyses (OR 1.27; 95% CI, 1.15-1.40; OR 0.62; 95% CI, 0.55-0.69; 1.05, respectively). CONCLUSION Although IMTB had negligible impacts on the drug's effect on acute events, as these are unlikely to be accompanied with hospitalizations, it negatively biased the drug's effect on mortality, an outcome with prodromal phases, in the three self-controlled designs.
Collapse
Affiliation(s)
- Han Eol Jeong
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, Republic of Korea
| | - Hyesung Lee
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, Republic of Korea
| | - In-Sun Oh
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, Republic of Korea
| | - Kristian B. Filion
- Departments of Medicine and of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada,Centre for Clinical Epidemiology, Lady Davis Research Institute - Jewish General Hospital, Montreal, Quebec, Canada
| | - Ju-Young Shin
- School of Pharmacy, Sungkyunkwan University, Suwon, Gyeonggi-do, Republic of Korea,Department of Clinical Research Design & Evaluation, Samsung Advanced Institute for Health Sciences & Technology, Sungkyunkwan University, Seoul, Republic of Korea
| |
Collapse
|
5
|
Baek YH, Noh Y, Oh IS, Jeong HE, Filion KB, Lee H, Shin JY. Analytical Approaches to Reduce Selection Bias in As-Treated Analyses with Missing In-Hospital Drug Information. Drug Saf 2022; 45:1057-1067. [PMID: 35978219 DOI: 10.1007/s40264-022-01221-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/04/2022] [Indexed: 11/25/2022]
Abstract
INTRODUCTION While much attention has focused on immeasurable time bias as a potential exposure misclassification bias, it may also result in potential selection bias in cohort studies using an as-treated (or per protocol) exposure definition in which patients are censored upon treatment discontinuation. METHODS We examined analytical approaches to minimise informative censoring due to the absence of in-hospital drug data using a case study of β-blocker use and mortality in heart failure. We conducted a cohort study using Korea's healthcare database, including inpatient and outpatient drug data. Using an as-treated exposure definition, patients were followed up until death, β-blocker discontinuation (in the exposed), β-blocker initiation (in the unexposed), or end of study period. In 'complete prescription' analysis using inpatient and outpatient drug data, we estimated hazard ratios (HR) and 95% confidence intervals (CI) using a Cox proportional hazard model. In outpatient drug-based analyses, we attempted to reduce the bias using stabilised inverse probability weighting (IPW) for treatment crossovers, hospitalisation, and all artificial censorings. RESULTS An HR of 0.89 (95% CI 0.74-1.07) for β-blocker use versus non-use for all-cause mortality was found in 'complete prescription' analysis. Benefits were exaggerated when follow-up was assessed using outpatient drug data only (HR 0.71; 95% CI 0.57-0.89). Weighting by stabilised IPW for treatment crossovers and hospitalisation reduced the bias. CONCLUSIONS When using an as-treated exposure definition, missing in-hospital drug data induced selection bias in our case study. Using IPW for censoring mitigated bias from the hospitalisation-induced censorings.
Collapse
Affiliation(s)
- Yeon-Hee Baek
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea
| | - Yunha Noh
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea
| | - In-Sun Oh
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea.,Department of Biohealth Regulatory Science, Sungkyunkwan University, Seoul, South Korea
| | - Han Eol Jeong
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea.,Department of Biohealth Regulatory Science, Sungkyunkwan University, Seoul, South Korea
| | - Kristian B Filion
- Departments of Medicine and of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, QC, Canada.,Lady Davis Research Institute, Jewish General Hospital, Montreal, QC, Canada
| | - Hyesung Lee
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea
| | - Ju-Young Shin
- School of Pharmacy, Sungkyunkwan University, 2066, Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do, 16419, South Korea. .,Samsung Advanced Institute for Health Sciences and Technology (SAIHST), Sungkyunkwan University, Seoul, South Korea. .,Department of Biohealth Regulatory Science, Sungkyunkwan University, Seoul, South Korea.
| |
Collapse
|