1
|
Jean-Louis G, Seixas AA. The value of decentralized clinical trials: Inclusion, accessibility, and innovation. Science 2024; 385:eadq4994. [PMID: 39172847 DOI: 10.1126/science.adq4994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 07/24/2024] [Indexed: 08/24/2024]
Abstract
In this Review, we explore the transformative potential of decentralized clinical trials (DCTs) in addressing the limitations of traditional randomized controlled trials (RCTs). We highlight the merits of DCTs fostering greater inclusivity, efficiency, and adaptability. We emphasize the challenges of RCTs, including limited participant diversity and logistical barriers, geographical constraints, and mistrust in research institutions, showing how DCTs are preferred in addressing these challenges by utilizing remote digital technologies and community providers to enable broader, more inclusive participation. Furthermore, we underscore the potential of DCTs for democratizing clinical research. We also stress the importance of addressing unresolved challenges, including data security and privacy, remote patient monitoring, and regulatory variations. Research is needed to devise standardized protocols to streamline DCT processes, explore its long-term impacts on patient outcomes, and overcome challenges through equitable stakeholder engagement.
Collapse
Affiliation(s)
- Girardin Jean-Louis
- Department of Psychiatry and Behavioral Sciences, University of Miami Miller School of Medicine, Miami, FL 33136, USA
- Department of Neurology, Psychology, and Public Health, University of Miami Miller School of Medicine, Miami, FL 33136, USA
| | - Azizi A Seixas
- Department of Psychiatry and Behavioral Sciences, University of Miami Miller School of Medicine, Miami, FL 33136, USA
- Department of Informatics and Health Data Science, University of Miami Miller School of Medicine, Miami, FL 33136, USA
| |
Collapse
|
2
|
Sezgin E, Kocaballi AB, Dolce M, Skeens M, Militello L, Huang Y, Stevens J, Kemper AR. Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study. JMIR Hum Factors 2024; 11:e57114. [PMID: 39028995 PMCID: PMC11297373 DOI: 10.2196/57114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 05/03/2024] [Accepted: 05/24/2024] [Indexed: 07/21/2024] Open
Abstract
BACKGROUND Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution. OBJECTIVE This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources. METHODS This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot's design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported. RESULTS Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot's capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot. CONCLUSIONS Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.
Collapse
Affiliation(s)
- Emre Sezgin
- Nationwide Children's Hospital, Columbus, OH, United States
| | - A Baki Kocaballi
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Millie Dolce
- Nationwide Children's Hospital, Columbus, OH, United States
| | - Micah Skeens
- Nationwide Children's Hospital, Columbus, OH, United States
| | | | - Yungui Huang
- Nationwide Children's Hospital, Columbus, OH, United States
| | - Jack Stevens
- Nationwide Children's Hospital, Columbus, OH, United States
| | - Alex R Kemper
- Nationwide Children's Hospital, Columbus, OH, United States
| |
Collapse
|
3
|
Walters NL, Lindsey-Mills ZT, Brangan A, Savage SK, Schmidlen TJ, Morgan KM, Tricou EP, Betts MM, Jones LK, Sturm AC, Campbell-Salome G. Facilitating family communication of familial hypercholesterolemia genetic risk: Assessing engagement with innovative chatbot technology from the IMPACT-FH study. PEC INNOVATION 2023; 2:100134. [PMID: 37214500 PMCID: PMC10194298 DOI: 10.1016/j.pecinn.2023.100134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 01/31/2023] [Accepted: 02/01/2023] [Indexed: 05/24/2023]
Abstract
Objective To assess use of two web-based conversational agents, the Family Sharing Chatbot (FSC) and One Month Chatbot (OMC), by individuals with familial hypercholesterolemia (FH). Methods FSC and OMC were sent using an opt-out methodology to a cohort of individuals receiving a FH genetic result. Data from 7/1/2021 through 5/12/2022 was obtained from the electronic health record and the chatbots' HIPAA-secure web portal. Results Of 175 subjects, 21 (12%) opted out of the chatbots. Older individuals were more likely to opt out. Most (91/154, 59%) preferred receiving chatbots via the patient EHR portal. Seventy-five individuals (49%) clicked the FSC link, 62 (40%) interacted, and 36 (23%) shared a chatbot about their FH result with at least one relative. Ninety-two of the subjects received OMC, 22 (23%) clicked the link and 20 (21%) interacted. Individuals who shared were majority female and younger on average than the overall cohort. Reminders tended to increase engagement. Conclusion Results demonstrate characteristics relevant to chatbot engagement. Individuals may be more inclined to receive chatbots if integrated within the patient EHR portal. Frequent reminders can potentially improve chatbot utilization. Innovation FSC and OMC employ innovative digital health technology that can facilitate family communication about hereditary conditions.
Collapse
Affiliation(s)
| | | | - Andrew Brangan
- Geisinger, 100 N. Academy Avenue, Danville, PA 17822, USA
| | | | | | | | - Eric P. Tricou
- Geisinger, 100 N. Academy Avenue, Danville, PA 17822, USA
- Family Heart Foundation, 959 East Walnut Street Suite 220, Pasadena, CA 91106, USA
| | - Megan M. Betts
- Geisinger, 100 N. Academy Avenue, Danville, PA 17822, USA
- WellSpan Health, 45 Monument Road Suite 200, York 17403, PA, USA
| | - Laney K. Jones
- Geisinger, 100 N. Academy Avenue, Danville, PA 17822, USA
| | - Amy C. Sturm
- Geisinger, 100 N. Academy Avenue, Danville, PA 17822, USA
- 23andMe, 223 N Mathilda Avenue, Sunnyvale, CA 94086, USA
| | | |
Collapse
|
4
|
Harrington L. Is Your EHR Nudging You? AACN Adv Crit Care 2023; 34:179-181. [PMID: 37644629 DOI: 10.4037/aacnacc2023463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Affiliation(s)
- Linda Harrington
- Linda Harrington is an Independent Consultant, Health Informatics and Digital Strategy, and Adjunct Professor at Texas Christian University, 2800 South University Drive, Fort Worth, TX 76109
| |
Collapse
|
5
|
Marrs JC, Orlando ST, Saseen JJ, Novins-Montague S, Sandy LC, Waughtal J, Glorioso TJ, Ho PM. Description of patient questions received by clinical pharmacists in the Nudge Study. Am J Health Syst Pharm 2023; 80:1247-1254. [PMID: 37353220 PMCID: PMC10845234 DOI: 10.1093/ajhp/zxad139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Indexed: 06/25/2023] Open
Abstract
PURPOSE The Nudge Study is a patient level-randomized trial testing different text message medication refill reminders sent to patients assigned to 4 arms: (1) usual care, (2) generic text, (3) optimized text, and (4) optimized text plus chatbot. This report describes the frequency and types of patient questions sent to clinical pharmacists (CPs) following text reminders. METHODS Patients were enrolled from Denver Health and Hospital Authority (DHHA) and Veterans Affairs Eastern Colorado Health Care System (VA ECHCS) from October 1, 2019, through May 30, 2021. Included patients responded to at least 1 text or interactive voice response (IVR) message. Patients were dichotomized as those who posed at least 1 question to a CP and those who posed no questions. RESULTS Of the 6,325 patients enrolled in an intervention arm, 3,323 (52.5%) responded to at least 1 text or IVR message, and among those responding, 305 (9.2%) responded with a pharmacist question. Patient factors associated with submitting a CP question included age (45-74 years), enrollment from DHHA, and receipt of the optimized text or optimized text plus chatbot message versus the generic text. Questions to CP were in the following categories: medication related (48.2%), refill logistics (38.4%), cost (9.2%), and other (17.7%). CONCLUSION In a text messaging intervention focused on medication refills, there were few questions directed to the CP. Patients assigned to receive optimized texts were more likely to have questions. We hypothesize that this may suggest greater patient engagement regarding their condition, resulting in more questions.
Collapse
Affiliation(s)
- Joel C Marrs
- Department of Clinical Pharmacy and Translational Science, University of Tennessee Health Science Center, Nashville, TN, and Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, USA
| | - Steven T Orlando
- Veteran Affairs Eastern Colorado Health Care System, Aurora, CO, USA
| | - Joseph J Saseen
- Department of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado, Aurora, CO, and Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO, USA
| | - Sylvie Novins-Montague
- ACCORDS (Adult and Child Consortium for Health Outcomes Research and Delivery Science), Aurora, CO, USA
| | - Lisa Caputo Sandy
- Division of General Internal Medicine, University of Colorado School of Medicine, Aurora, CO, USA
| | - Joy Waughtal
- mHealth Impact Laboratory, Colorado School of Public Health, Aurora, CO, USA
| | | | - P Michael Ho
- Veteran Affairs Eastern Colorado Health Care System, Aurora, CO, and Department of Medicine, University of Colorado School of Medicine, Aurora, CO, USA
| |
Collapse
|
6
|
Boyd AD, Gonzalez-Guarda R, Lawrence K, Patil CL, Ezenwa MO, O’Brien EC, Paek H, Braciszewski JM, Adeyemi O, Cuthel AM, Darby JE, Zigler CK, Ho PM, Faurot KR, Staman KL, Leigh JW, Dailey DL, Cheville A, Del Fiol G, Knisely MR, Grudzen CR, Marsolo K, Richesson RL, Schlaeger JM. Potential bias and lack of generalizability in electronic health record data: reflections on health equity from the National Institutes of Health Pragmatic Trials Collaboratory. J Am Med Inform Assoc 2023; 30:1561-1566. [PMID: 37364017 PMCID: PMC10436149 DOI: 10.1093/jamia/ocad115] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 06/07/2023] [Accepted: 06/13/2023] [Indexed: 06/28/2023] Open
Abstract
Embedded pragmatic clinical trials (ePCTs) play a vital role in addressing current population health problems, and their use of electronic health record (EHR) systems promises efficiencies that will increase the speed and volume of relevant and generalizable research. However, as the number of ePCTs using EHR-derived data grows, so does the risk that research will become more vulnerable to biases due to differences in data capture and access to care for different subsets of the population, thereby propagating inequities in health and the healthcare system. We identify 3 challenges-incomplete and variable capture of data on social determinants of health, lack of representation of vulnerable populations that do not access or receive treatment, and data loss due to variable use of technology-that exacerbate bias when working with EHR data and offer recommendations and examples of ways to actively mitigate bias.
Collapse
Affiliation(s)
- Andrew D Boyd
- Department of Biomedical and Health Information Sciences, University of Illinois Chicago, Chicago, Illinois, USA
| | | | - Katharine Lawrence
- Department of Population Health, New York University Grossman School of Medicine, New York City, New York, USA
| | - Crystal L Patil
- College of Nursing, University of Illinois Chicago, Chicago, Illinois, USA
| | - Miriam O Ezenwa
- University of Florida College of Nursing, Gainesville, Florida, USA
| | - Emily C O’Brien
- Department of Population Health Sciences, Duke University School of Medicine, Durham, North Carolina, USA
| | - Hyung Paek
- Biostatistics (Health Informatics), Yale University, New Haven, Connecticut, USA
| | | | - Oluwaseun Adeyemi
- Ronald O. Perelman Department of Emergency Medicine, New York University Grossman School of Medicine, New York City, New York, USA
| | - Allison M Cuthel
- Ronald O. Perelman Department of Emergency Medicine, New York University Grossman School of Medicine, New York City, New York, USA
| | - Juanita E Darby
- College of Nursing, University of Illinois Chicago, Chicago, Illinois, USA
| | | | - P Michael Ho
- Division of Cardiology, University of Colorado School of Medicine, Aurora, Colorado, USA
| | - Keturah R Faurot
- Department of Physical Medicine and Rehabilitation, University of North Carolina School of Medicine, Chapel Hill, North Carolina, USA
| | - Karen L Staman
- Duke University School of Medicine, Durham, North Carolina, USA
| | - Jonathan W Leigh
- College of Nursing, University of Illinois Chicago, Chicago, Illinois, USA
| | - Dana L Dailey
- Physical Therapy, St. Ambrose University, Davenport, Iowa, USA
- Department of Physical Therapy and Rehabilitation Science Department, University of Iowa, Iowa City, Iowa, USA
| | - Andrea Cheville
- Mayo Clinic Comprehensive Cancer Center, Rochester, Minnesota, USA
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | | | - Corita R Grudzen
- Department of Medicine, Memorial Sloan Kettering Cancer Center, New York City, New York, USA
| | - Keith Marsolo
- Department of Population Health Sciences, Duke University School of Medicine, Durham, North Carolina, USA
| | - Rachel L Richesson
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Judith M Schlaeger
- College of Nursing, University of Illinois Chicago, Chicago, Illinois, USA
| |
Collapse
|
7
|
Gupta P, Sandy LC, Glorioso TJ, Khanna A, Khazanie P, Allen LA, Peterson PN, Bull S, Ho PJM. Secondary analysis of electronic opt-out consent in pragmatic research: A study design method to diversify clinical trials? Am Heart J 2023; 261:104-108. [PMID: 36966921 DOI: 10.1016/j.ahj.2023.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 03/06/2023] [Accepted: 03/22/2023] [Indexed: 05/26/2023]
Abstract
We conducted a multi-center pragmatic trial of a low-risk intervention focused on medication adherence using an opt-out consent approach, where patients could opt out by letter and then electronically. We focus on the cohort after opt-out by mail. Here, we describe that 8% of patients opted out electronically, resulting in a 92% participation rate. Patients who self-identify as Black or Hispanic were less likely to opt out in the study, and half the study cohort was female. This demographic data is useful for planning future trials employing this approach.
Collapse
Affiliation(s)
- Prerna Gupta
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO.
| | - Lisa C Sandy
- Anschutz Medical Center, Division of General Internal Medicine, University of Colorado, Aurora, CO
| | - Thomas J Glorioso
- Rocky Mountain Regional Veteran Affairs Medical Center, Cardiology Section, Aurora, CO
| | - Amber Khanna
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO
| | - Prateeti Khazanie
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO
| | - Larry A Allen
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO
| | - Pamela N Peterson
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO; Department of Cardiology, Denver Health, Denver, CO
| | - Sheana Bull
- Colorado School of Public Health, Aurora, CO
| | - Pei Jai Michael Ho
- Anschutz Medical Center, Division of Cardiology, University of Colorado, Aurora, CO; Rocky Mountain Regional Veteran Affairs Medical Center, Cardiology Section, Aurora, CO
| |
Collapse
|
8
|
Mistry N, Richardson V, Carey E, Porter S, Pincus S, Novins-Montague S, Elmer M, Lin CT, Ho PM, Anstett T. General improvements versus interruptive or non-interruptive alerts in the blood order set: study protocol for a randomized control trial to improve packed red blood cell utilization. Trials 2023; 24:314. [PMID: 37158929 PMCID: PMC10165805 DOI: 10.1186/s13063-023-07319-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Accepted: 04/20/2023] [Indexed: 05/10/2023] Open
Abstract
BACKGROUND Blood transfusions can serve as a life-saving treatment, but inappropriate blood product transfusions can result in patient harm and excess costs for health systems. Despite published evidence supporting restricted packed red blood cell (pRBC) usage, many providers transfuse outside of guidelines. Here, we report a novel prospective, randomized control trial to increase guideline-concordant pRBC transfusions comparing three variations of clinical decision support (CDS) in the electronic health record (EHR). METHODS All inpatient providers at University of Colorado Hospital (UCH) who order blood transfusions were randomized in a 1:1:1 fashion to the three arms of the study: (1) general order set improvements, (2) general order set improvements plus non-interruptive in-line help text alert, and (3) general order set improvements plus interruptive alert. Transfusing providers received the same randomized order set changes for 18 months. The primary outcome of this study is the guideline-concordant rate of pRBC transfusions. The primary objective of this study is to compare the group using the new interface (arm 1) versus the two groups using the new interface with interruptive or non-interruptive alerts (arms 2 and 3, combined). The secondary objectives compare guideline-concordant transfusion rates between arm 2 and arm 3 as well as comparing all of arms of the study in aggregate to historical controls. This trial concluded after 12 months on April 5, 2022. DISCUSSION CDS tools can increase guideline-concordant behavior. This trial will examine three different CDS tools to determine which type is most effective at increasing guideline-concordant blood transfusions. TRIAL REGISTRATION Registered on ClinicalTrials.gov 3/20/21, NCT04823273 . Approved by University of Colorado Institutional Review Board (19-0918), protocol version 1 4/19/2019, approved 4/30/2019.
Collapse
Affiliation(s)
- Neelam Mistry
- Division of Hospital Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus, 12401 East 17Th Avenue, Mailstop F-782, Aurora, CO, 80045, USA.
| | - Vanessa Richardson
- Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Evan Carey
- Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Samuel Porter
- Division of Hospital Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus, 12401 East 17Th Avenue, Mailstop F-782, Aurora, CO, 80045, USA
| | - Sharon Pincus
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Sylvie Novins-Montague
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Megan Elmer
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Chen-Tan Lin
- Division of Internal Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
| | - P Michael Ho
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
- Division of Cardiology, Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
| | - Tyler Anstett
- Division of Hospital Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus, 12401 East 17Th Avenue, Mailstop F-782, Aurora, CO, 80045, USA
- The NavLab, an Adult and Child Consortium of Outcome Research and Delivery Science (ACCORDS) Program, University of Colorado School of Medicine, Aurora, CO, USA
| |
Collapse
|
9
|
Morse B, Anstett T, Mistry N, Porter S, Pincus S, Lin CT, Novins-Montague S, Ho PM. User-Centered Design to Reduce Inappropriate Blood Transfusion Orders. Appl Clin Inform 2023; 14:28-36. [PMID: 36630999 PMCID: PMC9833954 DOI: 10.1055/s-0042-1759866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND To improve blood transfusion practices, we applied user-centered design (UCD) to evaluate potential changes to blood transfusion orders. OBJECTIVES The aim of the study is to build effective transfusion orders with different designs to improve guideline adherence. METHODS We developed three different versions of transfusion orders that varied how information was presented to clinicians ordering blood transfusions. We engaged 14 clinicians (residents, advanced practice providers [APPs], and attending physicians) from different specialties. We used the think aloud technique and rapid qualitative analysis to generate themes to incorporate into our modified orders. RESULTS Most end-users who participated in the semi-structured interviews preferred the interruptive alert design plus behavioral nudges (n = 8/14, 57%). The predominant rationale was that the in-line alert was not visually effective in capturing the end-user's attention, while the interruptive alert forced a brief stop in the workflow to consider the guidelines. All users supported the general improvements, though for different reasons, and as a result, the general improvements remained in the designs for the forthcoming trial. CONCLUSION The user experience uncovered through the think aloud approach produced a clear and rich understanding of potentially confounding factors in the initial design of different intervention versions. Input from end-users guided the creation of all three designs so each was addressing human factors with parity, which ensured that the results of our study reflected differences in interruptive properties of the alerts and not differences in design.
Collapse
Affiliation(s)
- Brad Morse
- Department of Medicine, Division of General Internal Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States,Address for correspondence Brad Morse, PhD, MA Department of Medicine, Division of General Internal Medicine, University of Colorado School of Medicine1890 N Revere Ct, Aurora, CO 80045United States
| | - Tyler Anstett
- Department of Medicine, Division Hospital Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States
| | - Neelam Mistry
- Department of Medicine, Division Hospital Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States
| | - Samuel Porter
- Department of Medicine, Division Hospital Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States
| | - Sharon Pincus
- Adult & Child Center for Outcomes Research & Delivery Science/The NavLab, University of Colorado Anschutz Medical Campus, Aurora, Colorado, United States
| | - Chen-Tan Lin
- Department of Medicine, Division of General Internal Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States
| | - Sylvie Novins-Montague
- Adult & Child Center for Outcomes Research & Delivery Science/The NavLab, University of Colorado Anschutz Medical Campus, Aurora, Colorado, United States
| | - P. Michael Ho
- Department of Medicine, Division of Cardiology, University of Colorado School of Medicine, Aurora, Colorado, United States
| |
Collapse
|
10
|
Osula D, Wu B, Schesing K, Das SR, Moss E, Alvarez K, Clark C, Halm EA, Brown NJ, Vongpatanasin W. Comparison of Pharmacy Refill Data With Chemical Adherence Testing in Assessing Medication Nonadherence in a Safety Net Hospital Setting. J Am Heart Assoc 2022; 11:e027099. [PMID: 36193931 PMCID: PMC9673714 DOI: 10.1161/jaha.122.027099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Background Pharmacy fill data are a practical tool for assessing medication nonadherence. However, previous studies have not compared the accuracy of pharmacy fill data to measurement of plasma drug levels, or chemical adherence testing (CAT). Methods and Results We performed a cross-sectional study in patients with uncontrolled hypertension in outpatient clinics in a safety net health system. Plasma samples were obtained for measurement of common cardiovascular drugs, including calcium channel blockers, thiazide diuretics, beta blockers, angiotensin-converting enzyme inhibitors/angiotensin receptor blockers, and statins, using liquid chromatography mass spectrometry. Proportion of days covered (PDC), a method for tracking pharmacy fill data, was calculated via linkages with Surescripts, and its diagnostic test characteristics were compared with CAT. Among 77 patients with uncontrolled hypertension, 13 (17%) were nonadherent to at least 1 antihypertensive drug and 23 (37%) were nonadherent to statins by CAT. PDC was significantly lower in the nonadherent versus the adherent group by CAT only among patients prescribed an angiotensin-converting enzyme inhibitor/angiotensin receptor blocker or statin (all P<0.05) but not in patients prescribed other drug classes. The sensitivity and specificity of PDC in detecting nonadherence to angiotensin-converting enzyme inhibitors/angiotensin receptor blockers and statin drugs by CAT were 75% to 82% and 56% to 79%, respectively. The positive predictive value of PDC in detecting nonadherence was only 11% to 27% for antihypertensive drugs and 45% for statins. Conclusions PDC is useful in detecting nonadherence to angiotensin-converting enzyme inhibitors/angiotensin receptor blockers and statins but has limited usefulness in detecting nonadherence to calcium channel blockers, beta blockers, or thiazide diuretics and has a low positive predictive value for all drug classes.
Collapse
Affiliation(s)
- David Osula
- Department of Internal MedicineParkland Health & Hospital SystemDallasTX
| | - Bryan Wu
- Department of Internal MedicineParkland Health & Hospital SystemDallasTX
| | - Kevin Schesing
- Department of Internal MedicineParkland Health & Hospital SystemDallasTX
| | - Sandeep R. Das
- Cardiology DivisionParkland Health & Hospital SystemDallasTX
| | - Elizabeth Moss
- UT Southwestern Medical Center, Department of MedicineParkland Health & Hospital SystemDallasTX
| | - Kristin Alvarez
- UT Southwestern Medical Center, Department of MedicineParkland Health & Hospital SystemDallasTX
| | - Christopher Clark
- UT Southwestern Medical Center, Department of MedicineParkland Health & Hospital SystemDallasTX
| | - Ethan A. Halm
- Department of MedicineRobert Wood Johnson Medical SchoolNew BrunswickNJ
| | | | - Wanpen Vongpatanasin
- Cardiology DivisionParkland Health & Hospital SystemDallasTX
- Hypertension SectionUT Southwestern Medical CenterDallasTX
| |
Collapse
|
11
|
Khedraki R, Srivastava AV, Bhavnani SP. Framework for Digital Health Phenotypes in Heart Failure. Heart Fail Clin 2022; 18:223-244. [DOI: 10.1016/j.hfc.2021.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
12
|
Chen Y, Harris S, Rogers Y, Ahmad T, Asselbergs FW. OUP accepted manuscript. Eur Heart J 2022; 43:1296-1306. [PMID: 35139182 PMCID: PMC8971005 DOI: 10.1093/eurheartj/ehac030] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Revised: 01/11/2022] [Accepted: 01/17/2022] [Indexed: 12/15/2022] Open
Abstract
The increasing volume and richness of healthcare data collected during routine clinical
practice have not yet translated into significant numbers of actionable insights that have
systematically improved patient outcomes. An evidence-practice gap continues to exist in
healthcare. We contest that this gap can be reduced by assessing the use of nudge theory
as part of clinical decision support systems (CDSS). Deploying nudges to modify clinician
behaviour and improve adherence to guideline-directed therapy represents an underused tool
in bridging the evidence-practice gap. In conjunction with electronic health records
(EHRs) and newer devices including artificial intelligence algorithms that are
increasingly integrated within learning health systems, nudges such as CDSS alerts should
be iteratively tested for all stakeholders involved in health decision-making: clinicians,
researchers, and patients alike. Not only could they improve the implementation of known
evidence, but the true value of nudging could lie in areas where traditional randomized
controlled trials are lacking, and where clinical equipoise and variation dominate. The
opportunity to test CDSS nudge alerts and their ability to standardize behaviour in the
face of uncertainty may generate novel insights and improve patient outcomes in areas of
clinical practice currently without a robust evidence base.
Collapse
Affiliation(s)
- Yang Chen
- Institute of Health Informatics, University College London,
222 Euston Road, London NW1 2DA, UK
- Clinical Research Informatics Unit, University College London Hospitals NHS
Healthcare Trust, London, UK
- Barts Heart Centre, St Bartholomew’s Hospital, London,
UK
| | - Steve Harris
- Institute of Health Informatics, University College London,
222 Euston Road, London NW1 2DA, UK
| | - Yvonne Rogers
- UCL Interaction Centre, University College London, London,
UK
| | - Tariq Ahmad
- Section of Cardiovascular Medicine, School of Medicine, Yale
University, New Haven, CT, USA
| | | |
Collapse
|
13
|
Sandy LC, Glorioso TJ, Weinfurt K, Sugarman J, Peterson PN, Glasgow RE, Ho PM. Leave me out: Patients' characteristics and reasons for opting out of a pragmatic clinical trial involving medication adherence. Medicine (Baltimore) 2021; 100:e28136. [PMID: 34941059 PMCID: PMC8702195 DOI: 10.1097/md.0000000000028136] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 11/16/2021] [Indexed: 01/05/2023] Open
Abstract
Opt-out procedures are sometimes used instead of standard consent practices to enable patients to exercise their autonomous preferences regarding research participation while reducing patient and researcher burden. However, little is known about the characteristics of patients who opt-out of research and their reasons for doing so. We gathered such information in a large pragmatic clinical trial (PCT) evaluating the effect of theory informed text messages on medication adherence.Eligible patients, identified through electronic health records, were sent information about the study and provided with an opportunity to opt-out. Those opting out were asked to complete a voluntary survey regarding their reasons for doing so. Demographic data were compared among patients opting-out vs those included in the study using chi-squared tests and a log binomial regression model.Of 9046 patients receiving study packets, 906 (10.0%) patients returned opt-out forms. Of those, 451 (49.8%) returned the opt-out survey. Patients who opted out were more likely to be older, white, and nonHispanic than those who were included in the PCT. Survey respondents expressed high levels of trust in their health care providers, research, and system. Nearly half (46.6%) reported concerns about time as a reason to opt-out.In this PCT, 10% of patients receiving packets opted out, with significant differences in age, race, gender, and ethnicity compared to those included. Future trials should further investigate representativeness and reasons patients choose to opt-out of participating in research.
Collapse
Affiliation(s)
- Lisa Caputo Sandy
- General Internal Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO
- University of Colorado University of Colorado Anschutz Medical Campus, 13199 E Montview Blvd, Suite 300 Aurora, CO
| | | | - Kevin Weinfurt
- Department of Population and Health Sciences, Duke University, Durham, NC
| | - Jeremy Sugarman
- Berman Institute of Bioethics, Johns Hopkins University, Baltimore, MD
| | - Pamela N. Peterson
- Department of Internal Medicine, Denver Health and Hospital Authority, Denver, CO
- School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO
| | - Russell E. Glasgow
- Department of Family Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus, Aurora, CO
| | - P. Michael Ho
- VA Eastern Colorado Health Care System, Aurora, CO
- School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO
| |
Collapse
|