1
|
Plombon S, S. Rudin R, Sulca Flores J, Goolkasian G, Sousa J, Rodriguez J, Lipsitz S, Foer D, K. Dalal A. Assessing Equitable Recruitment in a Digital Health Trial for Asthma. Appl Clin Inform 2023; 14:620-631. [PMID: 37164328 PMCID: PMC10412068 DOI: 10.1055/a-2090-5745] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 05/06/2023] [Indexed: 05/12/2023] Open
Abstract
OBJECTIVE This study aimed to assess a multipronged strategy using primarily digital methods to equitably recruit asthma patients into a clinical trial of a digital health intervention. METHODS We approached eligible patients using at least one of eight recruitment strategies. We recorded approach dates and the strategy that led to completion of a web-based eligibility questionnaire that was reported during the verbal consent phone call. Study team members conducted monthly sessions using a structured guide to identify recruitment barriers and facilitators. The proportion of participants who reported being recruited by a portal or nonportal strategy was measured as our outcomes. We used Fisher's exact test to compare outcomes by equity variable, and multivariable logistic regression to control for each covariate and adjust effect size estimates. Using grounded theory, we coded and extracted themes regarding recruitment barriers and facilitators. RESULTS The majority (84.4%) of patients who met study inclusion criteria were patient portal enrollees. Of 6,366 eligible patients who were approached, 627 completed the eligibility questionnaire and were less frequently Hispanic, less frequently Spanish-speaking, and more frequently patient portal enrollees. Of 445 patients who consented to participate, 241 (54.2%) reported completing the eligibility questionnaire after being contacted by a patient portal message. In adjusted analysis, only race (odds ratio [OR]: 0.46, 95% confidence interval [CI]: 0.28-0.77, p = 0.003) and college education (OR: 0.60, 95% CI: 0.39-0.91, p = 0.016) remained significant. Key recruitment barriers included technology issues (e.g., lack of email access) and facilitators included bilingual study staff, Spanish-language recruitment materials, targeted phone calls, and clinician-initiated "1-click" referrals. CONCLUSION A primarily digital strategy to recruit patients into a digital health trial is unlikely to achieve equitable participation, even in a population overrepresented by patient portal enrollees. Nondigital recruitment methods that address racial and educational disparities and less active portal enrollees are necessary to ensure equity in clinical trial enrollment.
Collapse
Affiliation(s)
- Savanna Plombon
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
| | - Robert S. Rudin
- Healthcare Division, RAND Corporation, Boston, Massachusetts, United States
| | - Jorge Sulca Flores
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
| | - Gillian Goolkasian
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
| | - Jessica Sousa
- Healthcare Division, RAND Corporation, Boston, Massachusetts, United States
| | - Jorge Rodriguez
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
- Harvard Medical School, Boston, Massachusetts, United States
| | - Stuart Lipsitz
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
- Harvard Medical School, Boston, Massachusetts, United States
| | - Dinah Foer
- Harvard Medical School, Boston, Massachusetts, United States
- Division of General Internal Medicine, Brigham and Women's Hospital, Boston, Massachusetts, United States
- Division of Allergy and Clinical Immunology, Brigham and Women's Hospital, Boston, Massachusetts, United States
| | - Anuj K. Dalal
- Division of General Internal Medicine Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, United States
- Harvard Medical School, Boston, Massachusetts, United States
| |
Collapse
|
2
|
Malik MA, Motta-Calderon D, Piniella N, Garber A, Konieczny K, Lam A, Plombon S, Carr K, Yoon C, Griffin J, Lipsitz S, Schnipper JL, Bates DW, Dalal AK. A structured approach to EHR surveillance of diagnostic error in acute care: an exploratory analysis of two institutionally-defined case cohorts. Diagnosis (Berl) 2022; 9:446-457. [PMID: 35993878 PMCID: PMC9651987 DOI: 10.1515/dx-2022-0032] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 07/12/2022] [Indexed: 12/29/2022]
Abstract
OBJECTIVES To test a structured electronic health record (EHR) case review process to identify diagnostic errors (DE) and diagnostic process failures (DPFs) in acute care. METHODS We adapted validated tools (Safer Dx, Diagnostic Error Evaluation Research [DEER] Taxonomy) to assess the diagnostic process during the hospital encounter and categorized 13 postulated e-triggers. We created two test cohorts of all preventable cases (n=28) and an equal number of randomly sampled non-preventable cases (n=28) from 365 adult general medicine patients who expired and underwent our institution's mortality case review process. After excluding patients with a length of stay of more than one month, each case was reviewed by two blinded clinicians trained in our process and by an expert panel. Inter-rater reliability was assessed. We compared the frequency of DE contributing to death in both cohorts, as well as mean DPFs and e-triggers for DE positive and negative cases within each cohort. RESULTS Twenty-seven (96.4%) preventable and 24 (85.7%) non-preventable cases underwent our review process. Inter-rater reliability was moderate between individual reviewers (Cohen's kappa 0.41) and substantial with the expert panel (Cohen's kappa 0.74). The frequency of DE contributing to death was significantly higher for the preventable compared to the non-preventable cohort (56% vs. 17%, OR 6.25 [1.68, 23.27], p<0.01). Mean DPFs and e-triggers were significantly and non-significantly higher for DE positive compared to DE negative cases in each cohort, respectively. CONCLUSIONS We observed substantial agreement among final consensus and expert panel reviews using our structured EHR case review process. DEs contributing to death associated with DPFs were identified in institutionally designated preventable and non-preventable cases. While e-triggers may be useful for discriminating DE positive from DE negative cases, larger studies are required for validation. Our approach has potential to augment institutional mortality case review processes with respect to DE surveillance.
Collapse
Affiliation(s)
- Maria A. Malik
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Daniel Motta-Calderon
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Nicholas Piniella
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Alison Garber
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Kaitlyn Konieczny
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Alyssa Lam
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Savanna Plombon
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Kevin Carr
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | - Catherine Yoon
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
| | | | - Stuart Lipsitz
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Jeffrey L. Schnipper
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - David W. Bates
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Anuj K. Dalal
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| |
Collapse
|
3
|
Plombon S, Henneberger PK, Humann MJ, Liang X, Doney BC, Kelly KM, Cox-Ganser JM. The association of chronic bronchitis and airflow obstruction with lifetime and current farm activities in a sample of rural adults in Iowa. Int Arch Occup Environ Health 2022; 95:1741-1754. [PMID: 35482110 PMCID: PMC10424266 DOI: 10.1007/s00420-022-01866-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 04/04/2022] [Indexed: 12/30/2022]
Abstract
OBJECTIVE Farmers have an increased risk for chronic bronchitis and airflow obstruction. The objective of this study was to investigate the association of these health outcomes with farm activities. METHODS We evaluated the Keokuk County Rural Health Study (KCRHS) enrollment data for farm activities and the two health outcomes chronic bronchitis based on self-reported symptoms and airflow obstruction based on spirometry. We used logistic regression to model the health outcomes, yielding an odds ratio (OR) and 95% confidence interval (95% CI) for farm activities while adjusting for potential confounders and other risk factors. RESULTS Of the 1234 farmers, 104 (8.4%) had chronic bronchitis, 75 (6.1%) fulfilled the criteria for airflow obstruction, and the two outcomes overlapped by 18 participants. Chronic bronchitis without airflow obstruction (n = 86) had a statistically significant association with crop storage insecticides (OR 3.1, 95% CI 1.6, 6.1) and a low number of years (≤ 3) worked with turkeys (OR 3.3, 95% CI 1.2, 9.4). The latter result should be interpreted with caution because it is based on a small number of cases (n = 5). Airflow obstruction with or without chronic bronchitis (n = 75) was significantly associated with ever working in a hog or chicken confinement setting (OR 2.2, 95% CI 1.0, 4.5). CONCLUSIONS These results suggest that work with crop storage insecticides or turkeys may increase the risk for chronic bronchitis and work in hog or chicken confinement may increase the risk for airflow obstruction.
Collapse
Affiliation(s)
- Savanna Plombon
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA
| | - Paul K Henneberger
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA.
| | - Michael J Humann
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA
| | - Xiaoming Liang
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA
| | - Brent C Doney
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA
| | - Kevin M Kelly
- Department of Occupational and Environmental Health, The University of Iowa, Iowa City, IA, USA
| | - Jean M Cox-Ganser
- Respiratory Health Division, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, MS H2900, 1000 Frederick Lane, Morgantown, WV, 26508, USA
| |
Collapse
|
4
|
Serna MK, Fiskio J, Yoon C, Plombon S, Lakin JR, Schnipper JL, Dalal AK. Who Gets (and Who Should Get) a Serious Illness Conversation in the Hospital? An Analysis of Readmission Risk Score in an Electronic Health Record. Am J Hosp Palliat Care 2022:10499091221129602. [PMID: 36154485 DOI: 10.1177/10499091221129602] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Serious Illness Conversations (SICs) explore patients' prognostic awareness, hopes, and worries, and can help establish priorities for their care during and after hospitalization. While identifying patients who benefit from an SIC remains a challenge, this task may be facilitated by use of validated prediction scores available in most commercial electronic health records (EHRs), such as Epic's Readmission Risk Score (RRS). We identified the RRS on admission for all hospital encounters from October 2018 to August 2019 and measured the area under the receiver operating characteristic (AUROC) curve to determine whether RRS could accurately discriminate post discharge 6-month mortality. For encounters with standardized SIC documentation matched in a 1:3 ratio to controls by sex and age (±5 years), we constructed a multivariable, paired logistic regression model and measured the odds of SIC documentation per every 10% absolute increase in RRS. RRS was predictive of 6-month mortality with acceptable discrimination (AUROC .71) and was significantly associated with SIC documentation (adjusted OR 1.42, 95% CI 1.24-1.63). An RRS >28% used to identify patients with post discharge 6-month mortality had a high specificity (89.0%) and negative predictive value (NPV) (97.0%), but low sensitivity (25.2%) and positive predictive value (PPV) (7.9%). RRS may serve as a practical EHR-based screen to exclude patients not requiring an SIC, thereby leaving a smaller cohort to be further evaluated for SIC needs using other validated tools and clinical assessment.
Collapse
Affiliation(s)
- Myrna K Serna
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Julie Fiskio
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA
| | - Catherine Yoon
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA
| | - Savanna Plombon
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA
| | - Joshua R Lakin
- Harvard Medical School, Boston, MA, USA.,Department of Psychosocial Oncology and Palliative Care, 1855Dana Farber Cancer Institute, Boston, MA, USA
| | - Jeffrey L Schnipper
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Anuj K Dalal
- Hospital Medicine Unit, Division of General Internal Medicine and Primary Care, 1861Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| |
Collapse
|
5
|
Rudin RS, Perez S, Rodriguez JA, Sousa J, Plombon S, Arcia A, Foer D, Bates DW, Dalal AK. User-centered design of a scalable, electronic health record-integrated remote symptom monitoring intervention for patients with asthma and providers in primary care. J Am Med Inform Assoc 2021; 28:2433-2444. [PMID: 34406413 PMCID: PMC8510383 DOI: 10.1093/jamia/ocab157] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 07/06/2021] [Accepted: 07/13/2021] [Indexed: 01/09/2023] Open
Abstract
OBJECTIVE To determine user and electronic health records (EHR) integration requirements for a scalable remote symptom monitoring intervention for asthma patients and their providers. METHODS Guided by the Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework, we conducted a user-centered design process involving English- and Spanish-speaking patients and providers affiliated with an academic medical center. We conducted a secondary analysis of interview transcripts from our prior study, new design sessions with patients and primary care providers (PCPs), and a survey of PCPs. We determined EHR integration requirements as part of the asthma app design and development process. RESULTS Analysis of 26 transcripts (21 patients, 5 providers) from the prior study, 21 new design sessions (15 patients, 6 providers), and survey responses from 55 PCPs (71% of 78) identified requirements. Patient-facing requirements included: 1- or 5-item symptom questionnaires each week, depending on asthma control; option to request a callback; ability to enter notes, triggers, and peak flows; and tips pushed via the app prior to a clinic visit. PCP-facing requirements included a clinician-facing dashboard accessible from the EHR and an EHR inbox message preceding the visit. PCP preferences diverged regarding graphical presentations of patient-reported outcomes (PROs). Nurse-facing requirements included callback requests sent as an EHR inbox message. Requirements were consistent for English- and Spanish-speaking patients. EHR integration required use of custom application programming interfaces (APIs). CONCLUSION Using the NASSS framework to guide our user-centered design process, we identified patient and provider requirements for scaling an EHR-integrated remote symptom monitoring intervention in primary care. These requirements met the needs of patients and providers. Additional standards for PRO displays and EHR inbox APIs are needed to facilitate spread.
Collapse
Affiliation(s)
- Robert S Rudin
- Health Care Division, RAND Corporation, Boston, Massachusetts, USA
| | - Sofia Perez
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, USA
| | - Jorge A Rodriguez
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Jessica Sousa
- Health Care Division, RAND Corporation, Boston, Massachusetts, USA
| | - Savanna Plombon
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, USA
| | - Adriana Arcia
- School of Nursing, Columbia University School of Nursing, New York, New York, USA
| | - Dinah Foer
- Harvard Medical School, Boston, Massachusetts, USA
- Division of General Internal Medicine and Division of Allergy and Clinical Immunology, Brigham and Women’s Hospital, Boston, Massachusetts, USA
| | - David W Bates
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Anuj K Dalal
- Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|