1
|
Shapiro J, Avitan-Hersh E, Greenfield B, Khamaysi Z, Dodiuk-Gad RP, Valdman-Grinshpoun Y, Freud T, Lyakhovitsky A. The use of a ChatGPT-4-based chatbot in teledermatology: A retrospective exploratory study. J Dtsch Dermatol Ges 2025; 23:311-319. [PMID: 39801186 DOI: 10.1111/ddg.15609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2024] [Accepted: 10/10/2024] [Indexed: 03/08/2025]
Abstract
BACKGROUND AND OBJECTIVES Integration of artificial intelligence in healthcare, particularly ChatGPT, is transforming medical diagnostics and may benefit teledermatology. This exploratory study compared image description and differential diagnosis generation by a ChatGPT-4 based chatbot with human teledermatologists. PATIENTS AND METHODS This retrospective study compared 154 teledermatology consultations (December 2023-February 2024) with ChatGPT-4's performance in image descriptions and diagnoses. Diagnostic concordance was classified as "Top1" (exact match with the teledermatologist's diagnoses), "Top3" (correct diagnosis within one the top three diagnoses), and "Partial" (similar but not identical diagnoses). Image descriptions were rated and compared for quality parameters (location, color, size, morphology, and surrounding area), and accuracy (Yes, No, and Partial). RESULTS Out of 154 cases, ChatGPT-4 achieved a Top1 diagnostic concordance in 108 (70.8%), Top3 concordance in 137 (87.7%), partial concordance in four (2.6%), and was discordant in 15 (9.7%) cases. The quality of ChatGPT-4's image descriptions significantly surpassed teledermatologists in all five parameters. ChatGPT-4's descriptions were accurate in 130 (84.4%), partially accurate in 22 (14.3%), and inaccurate in two (1.3%) cases. CONCLUSIONS The preliminary findings of this study indicate that ChatGPT-4 demonstrates potential in generating accurate image descriptions and differential diagnoses. These results highlight the promise of integrating artificial intelligence into asynchronous teledermatology workflows.
Collapse
Affiliation(s)
| | - Emily Avitan-Hersh
- Rambam Health Care Campus, Haifa, Israel
- Dermatology Department, Bruce Rappaport Faculty of Medicine, Technion - Institute of Technology, Israel
| | | | - Ziad Khamaysi
- Rambam Health Care Campus, Haifa, Israel
- Dermatology Department, Bruce Rappaport Faculty of Medicine, Technion - Institute of Technology, Israel
| | - Roni P Dodiuk-Gad
- Dermatology Department, Bruce Rappaport Faculty of Medicine, Technion - Institute of Technology, Israel
- Emek Medical Center, Israel
- Department of Medicine, University of Toronto, Canada
| | | | - Tamar Freud
- Siaal Research Center for Family Medicine and Primary care, Department of Family Medicine, The Haim Doron Division of Community Health, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Anna Lyakhovitsky
- Sheba Medical Center, Tel Hashomer, Sackler School of Medicine, Faculty of Medical and Health Sciences, Tel Aviv University, Israel
| |
Collapse
|
2
|
Shapiro J, Lyakhovitsky A. Revolutionizing teledermatology: Exploring the integration of artificial intelligence, including Generative Pre-trained Transformer chatbots for artificial intelligence-driven anamnesis, diagnosis, and treatment plans. Clin Dermatol 2024; 42:492-497. [PMID: 38942153 DOI: 10.1016/j.clindermatol.2024.06.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2024]
Abstract
The integration of teledermatology and artificial intelligence (AI) marks a significant advancement in dermatologic care. This study examines the synergistic interplay between these two domains, highlighting their collective impact on enhancing the accuracy, accessibility, and efficiency of teledermatologic services. Teledermatology expands dermatologic care to remote and underserved areas, and AI technologies show considerable potential in analyzing dermatologic images and performing various tasks involved in teledermatology consultations. Such integration facilitates rapid, precise diagnoses, personalized treatment plans, and data-driven insights. Our explorative study involved designing a GPT-based chatbot named "Dr. DermBot" and exploring its performance in a teledermatologic consultation process. The design phase focused on the chatbot's ability to conduct consultations autonomously. The subsequent testing phase assessed its performance against the backdrop of current teledermatologic practices, exploring the potential of AI and chatbots to simulate and potentially enhance teledermatologic health care. Our study demonstrates the promising future of combining teledermatology with AI. It also brings to light ethical and legal concerns, including the protection of patient data privacy and adherence to regulatory standards. The union of teledermatology and AI not only aims to enhance the precision of teledermatologic diagnoses but also broadens the accessibility of dermatologic services to previously underserved populations, benefiting patients, health care providers, and the overall health care system.
Collapse
Affiliation(s)
- Jonathan Shapiro
- Department of Dermatology, Maccabi Healthcare Services, Tel Aviv, Israel.
| | - Anna Lyakhovitsky
- Department of Dermatology, Sheba Medical Center, Tel HaShomer, Israel; Department of Dermatology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
3
|
Totten AM, Womack DM, Griffin JC, McDonagh MS, Davis-O'Reilly C, Blazina I, Grusing S, Elder N. Telehealth-guided provider-to-provider communication to improve rural health: A systematic review. J Telemed Telecare 2024; 30:1209-1229. [PMID: 36567431 PMCID: PMC11389081 DOI: 10.1177/1357633x221139892] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
INTRODUCTION Telehealth may address healthcare disparities for rural populations. This systematic review assesses the use, effectiveness, and implementation of telehealth-supported provider-to-provider collaboration to improve rural healthcare. METHODS We searched Ovid MEDLINE®, CINAHL®, EMBASE, and Cochrane CENTRAL from 1 January 2010 to 12 October 2021 for trials and observational studies of rural provider-to-provider telehealth. Abstracts and full text were dual-reviewed. We assessed the risk of bias for individual studies and strength of evidence for studies with similar outcomes. RESULTS Seven studies of rural uptake of provider-to-provider telehealth documented increases over time but variability across geographic regions. In 97 effectiveness studies, outcomes were similar with rural provider-to-provider telehealth versus without for inpatient consultations, neonatal care, outpatient depression and diabetes, and emergency care. Better or similar results were reported for changes in rural clinician behavior, knowledge, confidence, and self-efficacy. Evidence was insufficient for other clinical uses and outcomes. Sixty-seven (67) evaluation and qualitative studies identified barriers and facilitators to implementing rural provider-to-provider telehealth. Success was linked to well-functioning technology, sufficient resources, and adequate payment. Barriers included lack of understanding of rural context and resources. Methodologic weaknesses of studies included less rigorous study designs and small samples. DISCUSSION Rural provider-to-provider telehealth produces similar or better results versus care without telehealth. Barriers to rural provider-to-provider telehealth implementation are common to practice change but include some specific to rural adaptation and adoption. Evidence gaps are partially due to studies that do not address differences in the groups compared or do not include sufficient sample sizes.
Collapse
Affiliation(s)
| | - Dana M Womack
- Oregon Health & Science University, Portland, OR, USA
| | | | | | | | - Ian Blazina
- Oregon Health & Science University, Portland, OR, USA
| | - Sara Grusing
- Oregon Health & Science University, Portland, OR, USA
| | - Nancy Elder
- Oregon Health & Science University, Portland, OR, USA
| |
Collapse
|
4
|
Kurtansky NR, D'Alessandro BM, Gillis MC, Betz-Stablein B, Cerminara SE, Garcia R, Girundi MA, Goessinger EV, Gottfrois P, Guitera P, Halpern AC, Jakrot V, Kittler H, Kose K, Liopyris K, Malvehy J, Mar VJ, Martin LK, Mathew T, Maul LV, Mothershaw A, Mueller AM, Mueller C, Navarini AA, Rajeswaran T, Rajeswaran V, Saha A, Sashindranath M, Serra-García L, Soyer HP, Theocharis G, Vos A, Weber J, Rotemberg V. The SLICE-3D dataset: 400,000 skin lesion image crops extracted from 3D TBP for skin cancer detection. Sci Data 2024; 11:884. [PMID: 39143096 PMCID: PMC11324883 DOI: 10.1038/s41597-024-03743-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 08/05/2024] [Indexed: 08/16/2024] Open
Abstract
AI image classification algorithms have shown promising results when applied to skin cancer detection. Most public skin cancer image datasets are comprised of dermoscopic photos and are limited by selection bias, lack of standardization, and lend themselves to development of algorithms that can only be used by skilled clinicians. The SLICE-3D ("Skin Lesion Image Crops Extracted from 3D TBP") dataset described here addresses those concerns and contains images of over 400,000 distinct skin lesions from seven dermatologic centers from around the world. De-identified images were systematically extracted from sensitive 3D Total Body Photographs and are comparable in optical resolution to smartphone images. Algorithms trained on lower quality images could improve clinical workflows and detect skin cancers earlier if deployed in primary care or non-clinical settings, where photos are captured by non-expert physicians or patients. Such a tool could prompt individuals to visit a specialized dermatologist. This dataset circumvents many inherent limitations of prior datasets and may be used to build upon previous applications of skin imaging for cancer detection.
Collapse
Affiliation(s)
- Nicholas R Kurtansky
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA.
| | | | - Maura C Gillis
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Brigid Betz-Stablein
- Frazer Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | - Sara E Cerminara
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | - Rafael Garcia
- Computer Vision and Robotics Institute, University of Girona, Girona, Spain
| | | | | | - Philippe Gottfrois
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | - Pascale Guitera
- Melanoma Institute Australia, Sydney, Australia
- Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Allan C Halpern
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | | | - Harald Kittler
- ViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - Kivanc Kose
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | | | - Josep Malvehy
- Dermatology Department, Hospital Clínic Barcelona, Universitat de Barcelona, IDIBAPS, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Enfermedades Raras (CIBER ER), Instituto de Salud Carlos III, Barcelona, Spain
| | - Victoria J Mar
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
- Victorian Melanoma Service, Alfred Hospital, 55 Commercial Road, Melbourne, VIC, 3004, Australia
| | - Linda K Martin
- Melanoma Institute Australia, Sydney, Australia
- Faculty of Medicine and Health, University of Sydney, Sydney, Australia
- School of Clinical Medicine, Faculty of Medicine & Health, University of New South Wales, Sydney, Australia
| | | | - Lara Valeska Maul
- Department of Dermatology, University Hospital of Zurich, Zurich, Switzerland
| | - Adam Mothershaw
- Frazer Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | - Alina M Mueller
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | - Christoph Mueller
- ViDIR Group, Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | | | | | | | - Anup Saha
- Computer Vision and Robotics Institute, University of Girona, Girona, Spain
| | - Maithili Sashindranath
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | | | - H Peter Soyer
- Frazer Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | | | - Ayesha Vos
- Victorian Melanoma Service, Alfred Hospital, 55 Commercial Road, Melbourne, VIC, 3004, Australia
| | - Jochen Weber
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Veronica Rotemberg
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| |
Collapse
|
5
|
Shapiro J, Lavi IK, Kun D, Ingber A, Freud T, Grunfeld O. Does the Diagnostic Accuracy and Rates of Face-to-Face Visits Occurring Shortly after an Asynchronized Teledermatology Consultation Justify Its Implementation? An 18-Month Cohort Study. Dermatology 2024; 240:425-433. [PMID: 38522421 DOI: 10.1159/000537823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 02/11/2024] [Indexed: 03/26/2024] Open
Abstract
INTRODUCTION In 2019, Maccabi Health Services (MHS) rolled out the store-and-forward "Dermadetect" teledermatology consultation (TC) application. Study goal was to analyze MHS records of TCs (August 2019-February 2021) for the rate and reasons for face-to-face consultations (FTFC) occurring shortly after a TC with emphasis on FTFCs resulting in a different diagnosis for the same indication. METHODS The records of FTFCs held up shortly after TCs were reviewed and classified into cases marked as unsuited for teledermatology, cases in which the indication differed, and cases with the same indication, which were analyzed for concordance of diagnoses. RESULTS Dermadetect was used by 12,815 MHS beneficiaries. In 30% of cases, following FTFC occurred within the subsequent 5 months, and 901 of them occurred in the subsequent 2 weeks and were analyzed. Thirty percent were not suited for teledermatology, 15% were held for a different indication, and 55% occurred for the same indication. The diagnosis concordance between the TC and recurrent FTFC for the same indication was 97.4%, with full concordance at 68.1% and partial concordance at 29.3%. Overall, 13 patients (1.4%) of the 901 patients using the application only once had a subsequent FTFC within 2 weeks and received a different diagnosis than the one given in the TC. CONCLUSIONS When considering the implementation of store-and-forward TC's, a 30% rate of following FTFC's during the next 5 months should be considered when planning the reimbursement model. Diagnosis discordance may be disregarded due to its low rates.
Collapse
Affiliation(s)
| | | | - Daniel Kun
- Maccabi Healthcare Services, Ramat Hasharon, Israel
| | - Arieh Ingber
- Department of Dermatology, Hadassah University Hospital, Jerusalem, Israel
| | - Tamar Freud
- Siaal Research Center for Family Medicine and Primary Care, Department of Family Medicine, The Haim Doron Division of Community Health, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | | |
Collapse
|
6
|
Jackson GL, Fix GM, White BS, Cutrona SL, Reardon CM, Damschroder LJ, Burns M, DeLaughter K, Opra Widerquist MA, Arasim M, Lindquist J, Gifford AL, King HA, Kaitz J, Jasuja GK, Hogan TP, Lopez JCF, Henderson B, Fitzgerald BA, Goetschius A, Hagan D, McCoy C, Seelig A, Nevedal A. Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration. FRONTIERS IN HEALTH SERVICES 2024; 3:1223277. [PMID: 38420338 PMCID: PMC10900518 DOI: 10.3389/frhs.2023.1223277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 11/20/2023] [Indexed: 03/02/2024]
Abstract
Introduction The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA. Methods Organized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators. Results In the first eight Shark Tanks (2016-2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank. Conclusion DoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care.
Collapse
Affiliation(s)
- George L. Jackson
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
- Advancing Implementation and Improvement Science Program, Peter O’Donnell Jr. School of Public Health, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Gemmae M. Fix
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
- Section of General Internal Medicine, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
- Department of Health Law, Policy & Management, Boston University, Boston, MA, United States
| | - Brandolyn S. White
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
| | - Sarah L. Cutrona
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
- Division of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States
| | - Caitlin M. Reardon
- Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI, United States
| | - Laura J. Damschroder
- Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI, United States
| | - Madison Burns
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
| | - Kathryn DeLaughter
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
| | | | - Maria Arasim
- Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI, United States
| | - Jennifer Lindquist
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
| | - Allen L. Gifford
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
- Section of General Internal Medicine, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
- Department of Health Law, Policy & Management, Boston University, Boston, MA, United States
| | - Heather A. King
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
- Department of Population Health Sciences, Duke University, Durham, NC, United States
- Division of General Internal Medicine, Duke University, Durham, NC, United States
| | - Jenesse Kaitz
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
| | - Guneet K. Jasuja
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
- Section of General Internal Medicine, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, United States
- Department of Health Law, Policy & Management, Boston University, Boston, MA, United States
| | - Timothy P. Hogan
- Advancing Implementation and Improvement Science Program, Peter O’Donnell Jr. School of Public Health, University of Texas Southwestern Medical Center, Dallas, TX, United States
- Center for Healthcare Organization & Implementation Research, Bedford & Boston VA Medical Centers, Bedford and Boston, MA, United States
| | - Jaifred Christian F. Lopez
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs (VA) Health Care System, Durham, NC, United States
- Department of Population Health Sciences, Duke University, Durham, NC, United States
| | - Blake Henderson
- VHA Innovation Ecosystem, Office of Healthcare Innovation and Learning, United States Veterans Health Administration, Washington, DC, United States
| | - Blaine A. Fitzgerald
- VHA Innovation Ecosystem, Office of Healthcare Innovation and Learning, United States Veterans Health Administration, Washington, DC, United States
| | - Amber Goetschius
- VHA Innovation Ecosystem, Office of Healthcare Innovation and Learning, United States Veterans Health Administration, Washington, DC, United States
| | - Danielle Hagan
- VHA Innovation Ecosystem, Office of Healthcare Innovation and Learning, United States Veterans Health Administration, Washington, DC, United States
| | - Carl McCoy
- VHA Innovation Ecosystem, Office of Healthcare Innovation and Learning, United States Veterans Health Administration, Washington, DC, United States
| | - Alex Seelig
- Agile Six Applications, Inc., San Diego, CA, United States
| | - Andrea Nevedal
- Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, MI, United States
| |
Collapse
|
7
|
Rouleau G, Wu K, Ramamoorthi K, Boxall C, Liu RH, Maloney S, Zelmer J, Scott T, Larsen D, Wijeysundera HC, Ziegler D, Bhatia S, Kishimoto V, Steele Gray C, Desveaux L. Mapping Theories, Models, and Frameworks to Evaluate Digital Health Interventions: Scoping Review. J Med Internet Res 2024; 26:e51098. [PMID: 38315515 PMCID: PMC10877497 DOI: 10.2196/51098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 11/10/2023] [Accepted: 12/27/2023] [Indexed: 02/07/2024] Open
Abstract
BACKGROUND Digital health interventions (DHIs) are a central focus of health care transformation efforts, yet their uptake in practice continues to fall short of their potential. In order to achieve their desired outcomes and impact, DHIs need to reach their target population and need to be used. Many factors can rapidly intersect between this dynamic of users and interventions. The application of theories, models, and frameworks (TMFs) can facilitate the systematic understanding and explanation of the complex interactions between users, practices, technology, and health system factors that underpin research questions. There remains a gap in our understanding of how TMFs have been applied to guide the evaluation of DHIs with real-world health system operations. OBJECTIVE This study aims to map TMFs used in studies to guide the evaluation of DHIs. The objectives are to (1) describe the TMFs and the constructs they target, (2) identify how TMFs have been prospectively used (ie, their roles) in primary studies to evaluate DHIs, and (3) to reflect on the relevance and utility of our findings for knowledge users. METHODS This scoping review was conducted in partnership with knowledge users using an integrated knowledge translation approach. We included papers (eg, reports; empirical quantitative, qualitative, and mixed methods studies; conference proceedings; and dissertations) if primary insights resulting from the application of TMFs were presented. Any type of DHI was eligible. Papers published from 2000 and onward were mainly identified from the following databases: MEDLINE (Ovid), CINAHL Complete (EBSCOhost), PsycINFO (Ovid), EBM Reviews (Ovid), and Embase (Ovid). RESULTS A total of 156 studies published between 2000 and 2022 were included. A total of 68 distinct TMFs were identified across 85 individual studies. In more than half (85/156, 55%) of the included studies, 1 of following 6 prevailing TMFs were reported: Consolidated Framework for Implementation Research (n=39); the Reach, Effectiveness, Adoption, Implementation, and Maintenance Framework (n=17); the Technology of Acceptance Model (n=16); the Unified Theory on Acceptance and Use of Technology (n=12); the Diffusion of Innovation Theory (n=10); and Normalization Process Theory (n=9). The most common intended roles of the 6 TMFs were to inform data collection (n=86), to inform data analysis (n=69), and to identify key constructs that may serve as barriers and facilitators (n=52). CONCLUSIONS As TMFs are most often reported to be applied to support data collection and analysis, researchers should consider more clearly synthesizing key insights as practical use cases to both increase the relevance and digestibility of their findings. There is also a need to adapt or develop guidelines for better reporting DHIs and the use of TMFs to guide evaluation. Hence, it would contribute to ensuring ongoing technology transformation efforts are evidence and theory informed rather than anecdotally driven.
Collapse
Affiliation(s)
- Geneviève Rouleau
- Nursing department, Université du Québec en Outaouais, Saint-Jérôme, QC, Canada
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
- Institut du Savoir Montfort, Montfort Hospital, Ottawa, ON, Canada
| | - Kelly Wu
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
| | - Karishini Ramamoorthi
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
| | - Cherish Boxall
- Southampton Clinical Trials Unit, University of Southampton, Southampton, United Kingdom
| | - Rebecca H Liu
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
| | | | | | - Ted Scott
- School of Nursing, Hamilton Health Sciences, McMaster University, Hamilton, ON, Canada
| | - Darren Larsen
- Telus Healthcare Delivery, Women's College Hospital, Toronto, ON, Canada
- Women's College Hospital Family Health Team, Women's College Hospital, Toronto, ON, Canada
| | | | - Daniela Ziegler
- Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
| | - Sacha Bhatia
- Ontario Health, Toronto, ON, Canada
- Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Vanessa Kishimoto
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
| | - Carolyn Steele Gray
- Lunenfeld-Tanenbaum Research Institute, Sinai Health, Toronto, ON, Canada
- Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Laura Desveaux
- Institute for Health System Solutions and Virtual Care Toronto, Women's College Hospital, Toronto, ON, Canada
- Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
- Institute for Better Health, Trillium Health Partners, Toronto, ON, Canada
| |
Collapse
|
8
|
Peracca SB, Lachica O, Lamkin RP, Jackson GL, Mohr DC, King HA, Whited JD, Fonseca AS, Morris IJ, Gifford AL, Weinstock MA, Oh DH. Implementation of Direct-to-Patient Mobile Teledermatology in VA. J Gen Intern Med 2024; 39:97-105. [PMID: 38252250 PMCID: PMC10937882 DOI: 10.1007/s11606-023-08480-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 10/12/2023] [Indexed: 01/23/2024]
Abstract
BACKGROUND Innovative technology can enhance patient access to healthcare but must be successfully implemented to be effective. OBJECTIVE We evaluated Department of Veterans Affairs' (VA's) implementation of My VA Images, a direct-to-patient asynchronous teledermatology mobile application enabling established dermatology patients to receive follow-up care remotely instead of in-person. DESIGN /PARTICIPANTS/APPROACH Following pilot testing at 3 facilities, the app was introduced to 28 facilities (4 groups of 7) every 3 months using a stepped-wedge cluster-randomized design. Using the Organizational Theory of Implementation Effectiveness, we examined the app's implementation using qualitative and quantitative data consisting of encounter data from VA's corporate data warehouse; app usage from VA's Mobile Health database; bi-monthly reports from facility representatives; phone interviews with clinicians; and documented communications between the operational partner and facility staff. KEY RESULTS Implementation policies and practices included VA's vision to expand home telehealth and marketing/communication strategies. The COVID-19 pandemic dominated the implementation climate by stressing staffing, introducing competing demands, and influencing stakeholder attitudes to the app, including its fit to their values. These factors were associated with mixed implementation effectiveness, defined as high quality consistent use. Nineteen of 31 exposed facilities prepared to use the app; 10 facilities used it for actual patient care, 7 as originally intended. Residents, nurse practitioners, and physician assistants were more likely than attendings to use the app. Facilities exposed to the app pre-pandemic were more likely to use and sustain the new process. CONCLUSIONS Considerable heterogeneity existed in implementing mobile teledermatology, despite VA's common mission, integrated healthcare system, and stakeholders' broad interest. Identifying opportunities to target favorable facilities and user groups (such as teaching facilities and physician extenders, respectively) while addressing internal implementation barriers including incomplete integration with the electronic health record as well as inadequate staffing may help optimize the initial impact of direct-to-patient telehealth. The COVID pandemic was a notable extrinsic barrier. CLINICAL TRIALS REGISTRATION NCT03241589.
Collapse
Affiliation(s)
- Sara B Peracca
- Dermatology Service (190), San Francisco VA Health Care System, 4150 Clement Street, San Francisco, CA, 94121, USA
| | - Olevie Lachica
- Dermatology Service (190), San Francisco VA Health Care System, 4150 Clement Street, San Francisco, CA, 94121, USA
| | - Rebecca P Lamkin
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, 02130, USA
| | - George L Jackson
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs Health Care System, 508 Fulton Street, Durham, NC, 27705, USA
- Peter O'Donnell Jr. School of Public Health, University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard, Dallas, TX, 75390, USA
| | - David C Mohr
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, 02130, USA
- Department of Health Law, Policy & Management, School of Public Health, Boston University, 715 Albany Street, Boston, MA, 02118, USA
| | - Heather A King
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs Health Care System, 508 Fulton Street, Durham, NC, 27705, USA
- Department of Population Health Sciences, Duke University, 215 Morris Street, Durham, NC, 27701, USA
- Division of General Internal Medicine, Duke University School of Medicine, 6301 Herndon Road, Durham, NC, 27713, USA
| | - John D Whited
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs Health Care System, 508 Fulton Street, Durham, NC, 27705, USA
- Division of General Internal Medicine, Duke University School of Medicine, 6301 Herndon Road, Durham, NC, 27713, USA
| | - Allene S Fonseca
- Department of Dermatology, Wayne State University, 18101 Oakwood Boulevard #402, Dearborn, MI, 48124, USA
| | - Isis J Morris
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham Veterans Affairs Health Care System, 508 Fulton Street, Durham, NC, 27705, USA
| | - Allen L Gifford
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, 02130, USA
- Department of Health Law, Policy & Management, School of Public Health, Boston University, 715 Albany Street, Boston, MA, 02118, USA
- Section of General Internal Medicine, Boston University Chobanian & Avedisian School of Medicine, 72 E Concord Street, Boston, MA, 02118, USA
| | - Martin A Weinstock
- Department of Dermatology and Epidemiology, Brown University, 593 Eddy Street, Providence, RI, 02903, USA
- Center for Dermatoepidemiology, Providence VA Medical Center, 830 Chalkstone Avenue, Providence, RI, 02908, USA
| | - Dennis H Oh
- Dermatology Service (190), San Francisco VA Health Care System, 4150 Clement Street, San Francisco, CA, 94121, USA.
- Department of Dermatology, University of California San Francisco, 1701 Divisadero Street, San Francisco, CA, 94115, USA.
| |
Collapse
|
9
|
Heyworth L, Shah N, Galpin K. 20 Years of Telehealth in the Veterans Health Administration: Taking Stock of Our Past and Charting Our Future. J Gen Intern Med 2024; 39:5-8. [PMID: 38378981 PMCID: PMC10937874 DOI: 10.1007/s11606-024-08617-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Affiliation(s)
- Leonie Heyworth
- Department of Veterans Affairs Central Office, Office of Connected Care/Telehealth, 810 Vermont Avenue, Washington, NW, DC 20420, USA.
| | - Nilesh Shah
- Department of Veterans Affairs Central Office, Office of Connected Care/Telehealth, 810 Vermont Avenue, Washington, NW, DC 20420, USA
| | - Kevin Galpin
- Department of Veterans Affairs Central Office, Office of Connected Care/Telehealth, 810 Vermont Avenue, Washington, NW, DC 20420, USA
| |
Collapse
|
10
|
Culmer N, Smith TB, Stager C, Wright A, Fickel A, Tan J, Clark C(T, Meyer H, Grimm K. Asynchronous Telemedicine: A Systematic Literature Review. TELEMEDICINE REPORTS 2023; 4:366-386. [PMID: 38143795 PMCID: PMC10739789 DOI: 10.1089/tmr.2023.0052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 10/31/2023] [Indexed: 12/26/2023]
Abstract
Background Asynchronous telemedicine (ATM), which describes telemedical interaction between a patient and provider where neither party communicates simultaneously, is an important telemedicine modality that is seeing increased use. In this article, we summarize the published peer-reviewed literature specifically related to ATM to (1) identify terms or phrases that are used to describe ATM, (2) ascertain how this research has thus far addressed the various aspects of the quadruple aim of medicine, and (3) assess the methodological rigor of research on ATM. We also divided the literature into pre- and post-COVID-19 onset periods to identify potential variations in the literature between these two periods. Methods This systematic literature review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The literature search, utilizing multiple databases and applying inclusion and exclusion criteria, initially produced 2624 abstracts for review. De-duplication and screening ultimately yielded 104 articles for data extraction. Results "Store-and-forward" and variations of "e-visit" were the most frequently used alternative terms for ATM. Care quality was the most frequently addressed aspect of the Quadruple Aim of Medicine-more than double any other category-followed by patient satisfaction. We separated cost of care into two categories: patients' cost of care and providers' cost to provide care. Patient cost of care was the third most addressed aspect of the Quadruple Aim of Medicine followed by provider well-being and provider's cost to provide care. Methodological rigor of the studies was also addressed, with only 2 quantitative studies ranked "Strong," 5 ranked "Moderate," and 97 ranked "Weak." Qualitative studies were generally acceptable but struggled methodologically with accounting for all participants and articulation of results. Conclusions Although "store-and-forward" is somewhat more frequently used in the studies included in this review, variants of "e-visit," are growing in recent usage. Given the relative newness of modality, it is not surprising that quality of care is the most researched aspect of the Quadruple Aim of Medicine in ATM research. We anticipate more balance between these areas as research in this field matures. Primary areas of research need currently relate to practitioners-specifically their costs of providing care and well-being. Finally, future ATM research needs to address research challenges of selection bias and blinding in quantitative studies and improved participant tracking and articulation of both study design and results in qualitative studies.
Collapse
Affiliation(s)
- Nathan Culmer
- College of Community Health Sciences, The University of Alabama, Tuscaloosa, Alabama, USA
| | - Todd Brenton Smith
- Capstone College of Nursing, The University of Alabama, Tuscaloosa, Alabama, USA
| | - Catanya Stager
- College of Community Health Sciences, The University of Alabama, Tuscaloosa, Alabama, USA
| | - Andrea Wright
- College of Community Health Sciences, The University of Alabama, Tuscaloosa, Alabama, USA
| | | | - Jet Tan
- The University of Alabama, Tuscaloosa, Alabama, USA
| | | | - Hannah Meyer
- The University of Alabama, Tuscaloosa, Alabama, USA
| | | |
Collapse
|
11
|
Kheterpal MK, Borre ED, Cheema U, Nicholas MW, Cooner EW, Phinney D, Gagnon K, Zullig LL, King HA, Malcolm EJ, Chen SC. Implementation evaluation of a teledermatology virtual clinic at an academic medical center. Implement Sci Commun 2023; 4:130. [PMID: 37891695 PMCID: PMC10612341 DOI: 10.1186/s43058-023-00508-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 10/04/2023] [Indexed: 10/29/2023] Open
Abstract
BACKGROUND Teledermatology (TD) is an evidence-based practice that may increase access to dermatologic care. We sought to use the Exploration, Preparation, Implementation, and Sustainment (EPIS) and the Reach, Efficacy, Adoption, Implementation, and Maintenance (RE-AIM) frameworks to evaluate implementation of TD at Duke. METHODS The EPIS and RE-AIM frameworks were deployed to design and implement a TD program that leveraged the strengths of the Duke University Health System and addressed previously reported barriers to implementation of store-and-forward and synchronous TD models. In the resultant hybrid TD model, trained primary care providers (PCPs) sent e-comm referrals with clinical and dermatoscopic images to dermatology. These e-consults were reviewed asynchronously and patients were scheduled for a synchronous video visit with dermatology within days. Dermatologists managed the patient plan. This hybrid TD model was piloted at four primary care clinics. Pertinent outcomes from a TD-adapted RE-AIM framework were tracked using electronic health record data. Patient satisfaction was assessed using a post-video visit survey (n = 18). Implementation barriers and facilitators were also collected through provider surveys (n = 24 PCPs, n = 10 dermatologists, n = 10 dermatology residents). RESULTS At four PCP clinics throughout 9/1/2021-4/30/2022, there were 218 TD referrals. Video visits occurred on average 7.5 ± 0.5 days after referral and 18/18 patients completing the post-visit survey were satisfied. Adoption varied between clinics, with one placing 22% of all dermatology referrals as TD and another placing 2%. The primary PCP barriers to TD were time burdens, lack of fit in clinic flow, and discomfort with image taking. Top-endorsed potential facilitating interventions included allowing for rash referrals without dermoscopy and assurance for clinical evaluation within 3 days. CONCLUSIONS The use of implementation science frameworks allowed for identification of system and contextual strengths which informed the hybrid TD pilot. Barriers and facilitating interventions will provide guidance for expansion and ongoing maintenance of TD.
Collapse
Affiliation(s)
- Meenal K Kheterpal
- Department of Dermatology, Duke University Medical Center, DUMC Box 3135, Durham, NC, 27710, USA.
| | - Ethan D Borre
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
| | | | - Matilda W Nicholas
- Department of Dermatology, Duke University Medical Center, DUMC Box 3135, Durham, NC, 27710, USA
| | - Edward W Cooner
- Duke Primary Care, Duke University School of Medicine, Durham, NC, USA
| | - Donna Phinney
- Duke Telehealth Office, Duke University Health System, Durham, NC, USA
| | - Kelly Gagnon
- Performance Services, Duke University Health System, Durham, NC, USA
| | - Leah L Zullig
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
| | - Heather A King
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Division of General Internal Medicine, Department of Medicine, Duke University School of Medicine, Durham, NC, USA
| | - Elizabeth J Malcolm
- Division of General Internal Medicine, Department of Medicine, Duke University School of Medicine, Durham, NC, USA
| | - Suephy C Chen
- Department of Dermatology, Duke University Medical Center, DUMC Box 3135, Durham, NC, 27710, USA
| |
Collapse
|
12
|
Lamkin RP, Peracca SB, Jackson GL, Hines AC, Gifford AL, Lachica O, Li D, Morris IJ, Paiva M, Weinstock MA, Oh DH. Using the RE-AIM framework to assess national teledermatology expansion. FRONTIERS IN HEALTH SERVICES 2023; 3:1217829. [PMID: 37936881 PMCID: PMC10627029 DOI: 10.3389/frhs.2023.1217829] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 10/02/2023] [Indexed: 11/09/2023]
Abstract
Background Teledermatology has been utilized in the United States Department of Veterans Affairs (VA) for decades but continues to have incomplete penetration. VA has funded an initiative to enhance access to dermatology services since 2017 to support asynchronous teledermatology for Veterans living in rural areas. As part of an ongoing evaluation of this program, we assessed the teledermatology activity between the fiscal years 2020 and 2022. We focused on the second cohort of the initiative, comprising six VA facilities and their 54 referral clinics. Methods We studied teledermatology programs at cohort facilities using the reach, effectiveness, adoption, implementation, and maintenance framework. We used a mixed-methods design including annual online reports completed by participating facilities and VA administrative data. When possible, we compared the data from the 3 years of teledermatology funding with the baseline year prior to the start of funding. Findings Reach: Compared with the baseline year, there was a 100% increase in encounters and a 62% increase in patients seen at the funded facilities. Over 500 clinicians and support staff members were trained. Effectiveness: In FY 2022, primary or specialty care clinics affiliated with the funded facilities had more dermatology programs than primary or specialty care clinics across the VA (83% vs. 71% of sites). Adoption: By the end of the funding period, teledermatology constituted 16% of dermatology encounters at the funded facilities compared with 12% nationally. This reflected an increase from 9.2% at the funded facilities and 10.3% nationally prior to the funding period. Implementation: The continued funding for staff and equipment facilitated the expansion to rural areas. Maintenance: By the end of the funding period, all facilities indicated that they had fully implemented their program for patients of targeted primary care providers. The Program Sustainability Index scores generally increased during the funding period. Conclusions Targeted funding to support asynchronous teledermatology implementation for rural Veterans increased its reach, adoption, and implementation, ultimately improving access. Providing program guidance with staffing and training resources can increase the impact of these programs. Ongoing efforts to maintain and increase communication between primary care and dermatology will be needed to sustain success.
Collapse
Affiliation(s)
- Rebecca P. Lamkin
- Center for Healthcare Organizational and Implementation Research (CHOIR), VA Boston Healthcare System, Veterans Health Administration, United States Department of Veterans Affairs, Boston, MA, United States
| | - Sara B. Peracca
- Dermatology Service, San Francisco VA Health Care System, San Francisco, CA, United States
| | - George L. Jackson
- Center of Innovation to Accelerate Discovery & Practice Transformation (ADAPT), Durham VA Health Care System, Veterans Health Administration, United States Department of Veterans Affairs, Durham, NC, United States
- Peter O'Donnell, Jr. School of Public Health, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Aliya C. Hines
- Department of Medicine, Division of Dermatology, John D. Dingell VA Medical Center, United States Department of Veterans Affairs, Detroit, MI, United States
- Department of Dermatology, School of Medicine, Wayne State University, Detroit, MI, United States
| | - Allen L. Gifford
- Center for Healthcare Organizational and Implementation Research (CHOIR), VA Boston Healthcare System, Veterans Health Administration, United States Department of Veterans Affairs, Boston, MA, United States
- Department of Medicine, Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, United States
- Department of Health, Law, Policy and Management, School of Public Health, Boston University, Boston, MA, United States
| | - Olevie Lachica
- Dermatology Service, San Francisco VA Health Care System, San Francisco, CA, United States
| | - Donglin Li
- Center for Healthcare Organizational and Implementation Research (CHOIR), VA Boston Healthcare System, Veterans Health Administration, United States Department of Veterans Affairs, Boston, MA, United States
| | - Isis J. Morris
- Center of Innovation to Accelerate Discovery & Practice Transformation (ADAPT), Durham VA Health Care System, Veterans Health Administration, United States Department of Veterans Affairs, Durham, NC, United States
| | - Marcelo Paiva
- Center for Dermatology, Providence VA Medical Center, United States Department of Veterans Affairs, Providence, RI, United States
| | - Martin A. Weinstock
- Center for Dermatology, Providence VA Medical Center, United States Department of Veterans Affairs, Providence, RI, United States
- Department of Dermatology and Epidemiology, Brown University, Providence, RI, United States
- Office of Connected Care, Department of Veterans Affairs, Washington, DC, United States
| | - Dennis H. Oh
- Dermatology Service, San Francisco VA Health Care System, San Francisco, CA, United States
- Office of Connected Care, Department of Veterans Affairs, Washington, DC, United States
- Department of Dermatology, School of Medicine, University of California San Francisco, San Francisco, CA, United States
| |
Collapse
|
13
|
Damush TM, Wilkinson JR, Martin H, Miech EJ, Tang Q, Taylor S, Daggy JK, Bastin G, Islam R, Myers LJ, Penney LS, Narechania A, Schreiber SS, Williams LS. The VA National TeleNeurology Program implementation: a mixed-methods evaluation guided by RE-AIM framework. FRONTIERS IN HEALTH SERVICES 2023; 3:1210197. [PMID: 37693238 PMCID: PMC10484508 DOI: 10.3389/frhs.2023.1210197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 08/01/2023] [Indexed: 09/12/2023]
Abstract
Introduction The Veteran Affairs (VA) Office of Rural Health (ORH) funded the Veterans Health Administration (VHA) National TeleNeurology Program (NTNP) as an Enterprise-Wide Initiative (EWI). NTNP is an innovative healthcare delivery model designed to fill the patient access gap for outpatient neurological care especially for Veterans residing in rural communities. The specific aim was to apply the RE-AIM framework in a pragmatic evaluation of NTNP services. Materials and methods We conducted a prospective implementation evaluation. Guided by the pragmatic application of the RE-AIM framework, we conceptualized a mixed-methods evaluation for key metrics: (1) reach into the Veteran patient population assessed as total NTNP new patient consult volume and total NTNP clinical encounters (new and return); (2) effectiveness through configurational analysis of conditions leading to high Veteran satisfaction and referring providers perceived effectiveness; (3) adoption and implementation by VA sites through site staff and NTNP interviews; (4) implementation success through perceived management, implementation barriers, facilitators, and adaptations and through rapid qualitative analysis of multiple stakeholders' assessments; and (5) maintenance of NTNP through monitoring quarterly TeleNeurology consultation volume. Results NTNP was successfully implemented in 13 VA Medical Centers over 2 years. The total NTNP new patient consult volume in fiscal year 2021 (FY21) was 836 (58% rurally residing); this increased to 1,706 in fiscal year 2022 (FY22) (55% rurally residing). Total (new and follow-up) NTNP clinical encounters were 1,306 in FY21 and 3,730 in FY22. Overall, the sites reported positive experiences with program implementation and perceived that the program was serving Veterans with little access to neurological care. Veterans also reported high satisfaction with the NTNP program. We identified the patient level of perceived excellent teleneurologist-patient communications, reduced need to drive to get care, and that NTNP provided care that the Veteran otherwise could not access as key factors related to high Veteran satisfaction. Conclusions The VA NTNP demonstrated substantial reach, adoption, effectiveness, implementation success, and maintenance over the first 2 years of the program. The NTNP was highly acceptable to both the clinical providers making the referrals and the Veterans receiving the referred video care. The pragmatic application of the RE-AIM framework to guide implementation evaluations is appropriate, comprehensive, and recommended for future applications.
Collapse
Affiliation(s)
- Teresa M. Damush
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, United States
- Regenstrief Institute, Inc., Indianapolis, IN, United States
| | - Jayne R. Wilkinson
- Corporal Michael J Crescenz VAMC, Philadelphia, PA, United States
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Holly Martin
- Regenstrief Institute, Inc., Indianapolis, IN, United States
| | - Edward J. Miech
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, United States
- Regenstrief Institute, Inc., Indianapolis, IN, United States
| | - Qing Tang
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN, United States
| | - Stanley Taylor
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
| | - Joanne K. Daggy
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN, United States
| | - Grace Bastin
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
| | - Robin Islam
- Corporal Michael J Crescenz VAMC, Philadelphia, PA, United States
| | - Laura J. Myers
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, United States
- Regenstrief Institute, Inc., Indianapolis, IN, United States
| | - Lauren S. Penney
- South Texas Veterans Health Care System, San Antonio, TX, United States
| | - Aditi Narechania
- Jesse Brown VAMC, Chicago, IL, United States
- University of Illinois Chicago, Chicago, IL, United States
- Northwestern University, Chicago, IL, United States
| | - Steve S. Schreiber
- Department of Neurology, University of California, Irvine, Irvine, CA, United States
| | - Linda S. Williams
- Richard L. Roudebush VAMC HSR&D EXTEND QUERI, Indianapolis, IN, United States
- Regenstrief Institute, Inc., Indianapolis, IN, United States
- Department of Neurology, Indiana University School of Medicine, Indianapolis, IN, United States
| |
Collapse
|
14
|
Peracca SB, Fonseca AS, Lachica O, Jackson GL, Morris IJ, King HA, Misitzis A, Whited JD, Mohr DC, Lamkin RP, Gifford AL, Weinstock MA, Oh DH. Organizational Readiness for Patient-Facing Mobile Teledermatology to Care for Established Veteran Patients in the United States. Telemed J E Health 2023; 29:72-80. [PMID: 35612465 DOI: 10.1089/tmj.2022.0009] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
Purpose: To improve patient access to skin care, the Department of Veterans Affairs (VA) developed a patient-facing asynchronous mobile teledermatology application (app), which allows patients to follow up remotely with dermatologists. To understand how the app would be received in VA, we examined Organizational Readiness for Change (ORC), an important prelude to effective implementation, which includes the shared resolve and collective ability of organizational members to implement a change. Methods: We used a mixed-methods multiple case study approach to assess ORC at three VA facilities. Data derived from a site process call, surveys, and semistructured telephone interviews of VA staff, field notes, and administrative data. Results: Participants at all three facilities supported the intervention and recognized the value of using the app to increase patients' access to dermatologists, but expressed concerns largely related to disruption of the pre-existing clinical workflow. Participants at the facility most actively using the app had the highest overall ORC score and reported the most facilitators. Facility leadership support when guided by a clinical champion minimized barriers by recognizing the complexities of health care provision at specialty clinics. Discussion: While provider buy-in remained a barrier, leadership, guided by the clinical champion, played a critical role instituting implementation strategies. The strong association between the ORC survey score and the presence of facilitators and barriers suggests that the ORC survey may be a rapid, convenient, and effective tool for health care systems to identify favorable sites for wider implementation of mobile telehealth care. Clinical Trials Identifier: NCT03241589.
Collapse
Affiliation(s)
- Sara B Peracca
- Dermatology Service, San Francisco VA Health Care System, San Francisco, California, USA
| | - Allene S Fonseca
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA.,Department of Dermatology and Epidemiology, Brown University, Providence, Rhode Island, USA
| | - Olevie Lachica
- Dermatology Service, San Francisco VA Health Care System, San Francisco, California, USA
| | - George L Jackson
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Department of Population Health Science, Duke University School of Medicine, Durham, North Carolina, USA.,Department of Medicine, Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA.,Department of Family Medicine and Community Health, Duke University School of Medicine, Durham, North Carolina, USA
| | - Isis J Morris
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA
| | - Heather A King
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Department of Population Health Science, Duke University School of Medicine, Durham, North Carolina, USA.,Department of Medicine, Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA
| | - Angelica Misitzis
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA.,Department of Dermatology and Epidemiology, Brown University, Providence, Rhode Island, USA
| | - John D Whited
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Department of Medicine, Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA
| | - David C Mohr
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA.,Department of Health Law, Policy and Management, School of Public Health, Boston University, Boston, Massachusetts, USA
| | - Rebecca P Lamkin
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA
| | - Allen L Gifford
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA.,Department of Health Law, Policy and Management, School of Public Health, Boston University, Boston, Massachusetts, USA.,Department of Medicine, Section of General Internal Medicine, School of Medicine, Boston University, Boston, Massachusetts, USA
| | - Martin A Weinstock
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA.,Department of Dermatology and Epidemiology, Brown University, Providence, Rhode Island, USA
| | - Dennis H Oh
- Dermatology Service, San Francisco VA Health Care System, San Francisco, California, USA.,Department of Dermatology, University of California at San Francisco, San Francisco, California, USA
| |
Collapse
|
15
|
Teledermatology in Rural, Underserved, and Isolated Environments: A Review. CURRENT DERMATOLOGY REPORTS 2022; 11:328-335. [PMID: 36310767 PMCID: PMC9589860 DOI: 10.1007/s13671-022-00377-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/07/2022] [Indexed: 11/03/2022]
Abstract
Purpose of Review Recent Findings Summary
Collapse
|
16
|
Pearlman RL, Brodell RT, Byrd AC. Enhancing Access to Rural Dermatological Care: The Time to Start Is Now. JAMA Dermatol 2022; 158:725-726. [PMID: 35612861 DOI: 10.1001/jamadermatol.2022.1470] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Affiliation(s)
- Ross L Pearlman
- Department of Dermatology, University of Mississippi Medical Center, Jackson
| | - Robert T Brodell
- Department of Dermatology, University of Mississippi Medical Center, Jackson
| | - Adam C Byrd
- Rural Dermatology Program, Department of Dermatology, University of Mississippi Medical Center, Jackson
| |
Collapse
|
17
|
Albright T, Simonet R, Bollom E, Taylor S, Seckel E, Wilcox A, Margolis A. Feasibility of a centralized specialty biologic medication management clinic at a VA hospital. J Am Pharm Assoc (2003) 2022; 62:1694-1699. [DOI: 10.1016/j.japh.2022.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 04/29/2022] [Accepted: 05/03/2022] [Indexed: 11/30/2022]
|
18
|
Castillo F, Peracca S, Oh DH, Twigg AR. The Utilization and Impact of Live Interactive and Store-and-Forward Teledermatology in a Veterans Affairs Medical Center During the COVID-19 Pandemic. Telemed J E Health 2021; 28:1186-1192. [PMID: 34919470 DOI: 10.1089/tmj.2021.0275] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Introduction: Teledermatology has emerged as a promising method of continuing dermatologic care during the coronavirus 2019 (COVID-19) pandemic, including in the Department of Veterans Affairs (VA). Analysis of the utilization and impact of teledermatology within the San Francisco Veterans Affairs Health Care System (SFVAHCS) may elucidate the ways that teledermatology programs can continue to be optimized. Methods: We conducted a retrospective analysis of live interactive encounters, Veterans Affairs Video Connect (VVC), store-and-forward telehealth (SFT), and face-to-face (FTF) consultations, performed within the SFVAHCS from March 2020 to December 2020. To assess utilization, we analyzed numbers of encounters throughout 2020. To assess impact, we analyzed primary diagnoses for each encounter and rates of recommendations for medications and lesion biopsies. Additionally, we assessed diagnostic accuracy associated with each teledermatology type by measuring concordance between teledermatologists' clinical diagnoses and histopathological diagnoses. Results: Two thousand two hundred fifty FTF, 347 VVC, and 470 SFT encounters were conducted from March to December 2020. More female patients utilized VVC, and patients who utilized VVC were younger than SFT and FTF users (p < 0.01). SFT was utilized more by patients from rural areas (p < 0.01). Diagnoses addressed were significantly different between VVC and SFT. A majority of VVC encounters involved referrals for inflammatory conditions; primary diagnoses associated with SFT consultations were most frequently neoplasms. Comparison of VVC and SFT outcomes showed that more VVC visits resulted in a medication recommendation, while more SFT consultations resulted in a biopsy recommendation. Conclusions: Teledermatology contributed to meeting patient needs throughout 2020 and created an impact on clinical management. Patient characteristics, diagnoses, and type of impact associated with encounters varied between SFT and VVC. This analysis provides insight into teledermatology utilization within the VA system and can contribute to efforts to improve the quality of teledermatology care for veterans.
Collapse
Affiliation(s)
- Francine Castillo
- Department of Dermatology, University of California, San Francisco School of Medicine, San Francisco, California, USA
| | - Sara Peracca
- Dermatology Research Unit, San Francisco VA Health Care System, San Francisco, California, USA
| | - Dennis H Oh
- Department of Dermatology, University of California, San Francisco School of Medicine, San Francisco, California, USA.,Dermatology Research Unit, San Francisco VA Health Care System, San Francisco, California, USA
| | - Amanda R Twigg
- Department of Dermatology, University of California, San Francisco School of Medicine, San Francisco, California, USA.,Dermatology Research Unit, San Francisco VA Health Care System, San Francisco, California, USA
| |
Collapse
|
19
|
Ibrahim AE, Magdy M, Khalaf EM, Mostafa A, Arafa A. Teledermatology in the time of COVID-19. Int J Clin Pract 2021; 75:e15000. [PMID: 34714575 PMCID: PMC8646275 DOI: 10.1111/ijcp.15000] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 09/20/2021] [Accepted: 10/27/2021] [Indexed: 12/11/2022] Open
Abstract
AIMS The enormous spread of the novel Corona virus disease (COVID-19) represents a challenge to dermatological practice. Accumulating evidence has suggested a possible role of teledermatology in facing this challenge. In this article, we aimed to give a general overview of teledermatology in terms of models of practice, modes of delivery, advantages, limitations, ethical considerations and legislative challenges as well as discussing, using examples from literature, how dermatological practice can benefit from teledermatology during the time of the COVID-19 pandemic. DISCUSSION AND CONCLUSION Teledermatology could be an accessible, accurate and cost-effective substitute for conventional face-to-face dermatological consultations during the COVID-19 pandemic. However, teledermatology practice needs updated legislation and guidelines. More efforts should be done to encourage dermatologists, especially in underserved communities, to provide teledermatology services. Ethical issues and data security related to teledermatology have to be considered.
Collapse
Affiliation(s)
- Ahmed Elsayed Ibrahim
- Department of NeuropsychiatryFaculty of MedicineAlexandria UniversityAlexandriaEgypt
| | - Mayar Magdy
- Barnet HospitalThe Royal Free London NHS Foundation TrustLondonUK
| | - Eslam M. Khalaf
- Department of Critical MedicineFaculty of MedicineAlexandria UniversityAlexandriaEgypt
| | - Alshimaa Mostafa
- Department of DermatologyGraduate School of MedicineKyoto UniversityKyotoJapan
- Department of DermatologyFaculty of MedicineBeni‐Suef UniversityBeni‐SuefEgypt
| | - Ahmed Arafa
- Department of Public HealthGraduate School of MedicineOsaka UniversitySuitaJapan
- Department of Public HealthFaculty of MedicineBeni‐Suef UniversityBeni‐SuefEgypt
| |
Collapse
|
20
|
Dovigi E, Lee I, Tejasvi T. Evaluation of Teledermatology Practice Guidelines and Recommendations for Improvement. Telemed J E Health 2021; 28:115-120. [DOI: 10.1089/tmj.2021.0011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
- Edwin Dovigi
- Department of Dermatology, Rush University Medical Center, Chicago, Illinois, USA
| | - Ivy Lee
- Pasadena Premier Dermatology, Pasadena, California, USA
| | - Trilokraj Tejasvi
- Department of Dermatology, University of Michigan, Ann Arbor, Michigan, USA
- Dermatology Service, Ann Arbor VA Medical Center, Ann Arbor, Michigan, USA
| |
Collapse
|
21
|
Peracca SB, Fonseca A, Hines A, King HA, Grenga AM, Jackson GL, Whited JD, Chapman JG, Lamkin R, Mohr DC, Gifford A, Weinstock MA, Oh DH. Implementation of Mobile Teledermatology: Challenges and Opportunities. Telemed J E Health 2021; 27:1416-1422. [PMID: 33691074 DOI: 10.1089/tmj.2020.0500] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background: While teledermatology is well-established in the Department of Veterans Affairs (VA), its implementation is far from complete. To facilitate consultative teledermatology and extend its reach, VA introduced a mobile teledermatology application (app) at three VA sites. Methods: We evaluated the initial implementation process using a mixed-methods, multiple case study approach to assess organizational readiness for change (ORC), which included examining facilitators, barriers, and contextual factors that affected implementation. We conducted: (1) group interviews and bimonthly reports to understand site processes; (2) semistructured interviews and surveys of individual participants representing a range of implementation roles; and (3) a review of internal organizational documents. We identified themes from interviews using an iterative process, and computed an ORC score based on surveys. Results: Forty-three individuals participated in the study. Qualitative data from all sites, corroborated by survey data available from one site, revealed a high readiness for change with an ORC score of 4.2, where 5 = maximal readiness for change. Facilitators included support from leadership and clinical champions, active telehealth programs, and an understanding and appreciation of the program and the resources needed. At all sites, however, technical issues negatively affected adoption; these included a suboptimal information technology infrastructure, which led to the inoperability of the app at two sites, and technical inefficiencies related to users' unfamiliarity with new devices and inconsistent internet access. Conclusions: Although a strong commitment to change and a confidence to effect change existed, these alone were insufficient to surmount barriers to implementation effectiveness. Clinical Trials Registration: NCT03241589.
Collapse
Affiliation(s)
- Sara B Peracca
- Dermatology Service, San Francisco VA Health Care System, San Francisco, California, USA
| | - Allene Fonseca
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA.,Department of Dermatology and Epidemiology, Brown University, Providence, Rhode Island, USA
| | - Aliya Hines
- VA Ann Arbor Health Care System, Ann Arbor, Michigan, USA
| | - Heather A King
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Department of Population Health Science, Duke University School of Medicine, Durham, North Carolina, USA.,Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA
| | - Andrea M Grenga
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA
| | - George L Jackson
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Department of Population Health Science, Duke University School of Medicine, Durham, North Carolina, USA.,Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA
| | - John D Whited
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA.,Division of General Internal Medicine, Duke University School of Medicine, Durham, North Carolina, USA
| | - Jennifer G Chapman
- Center of Innovation to Accelerate Discovery and Practice Transformation (ADAPT), Durham VA Health Care System, Durham, North Carolina, USA
| | - Rebecca Lamkin
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA
| | - David C Mohr
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA.,Department of Health Law, Policy and Management, School of Public Health, Boston University, Boston, Massachusetts, USA
| | - Allen Gifford
- Center for Healthcare Organization and Implementation Research (CHOIR), Veterans Affairs Boston Health Care System, Boston, Massachusetts, USA.,Department of Health Law, Policy and Management, School of Public Health, Boston University, Boston, Massachusetts, USA.,Department of Medicine, School of Medicine, Boston University, Boston, Massachusetts, USA
| | - Martin A Weinstock
- Center for Dermatoepidemiology, Providence VA Medical Center, Providence, Rhode Island, USA.,Department of Dermatology and Epidemiology, Brown University, Providence, Rhode Island, USA
| | - Dennis H Oh
- Dermatology Service, San Francisco VA Health Care System, San Francisco, California, USA.,Department of Dermatology, University of California at San Francisco, San Francisco, California, USA
| |
Collapse
|