1
|
Kohut M, Jalbuena T, Alfiero R, DiPalazzo J, Anderson E, Bishop J. Net Promoter Score as a Reflection of Patients' Opinions About Telemedical Visits: A Mixed Methods Analysis. Telemed J E Health 2025; 31:634-642. [PMID: 39728614 DOI: 10.1089/tmj.2024.0300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2024] Open
Abstract
Introduction: In order to assess patient experiences of telemedicine, researchers and administrators use the net promoter score (NPS), based on a likelihood to recommend (LTR) question. However, there is reason to doubt validity of this metric for this purpose. We assessed the degree to which the LTR question reflects actual patient preferences about telemedicine. Methods: Using data from a patient experience survey collected in Spring 2020, we compared LTR responses to open comments. Through content analysis, we transformed comments into categorical variables and used those variables in a multiple logistic regression model to predict LTR responses. We also thematically analyzed comments to further elucidate our results. Results: Only about half the comments mentioned telemedicine at all. Around 6% of comments were wholly incongruent with LTR responses. In many comments, ideas about telemedicine were semantically entangled with ideas about providers. Our logistic regression found strong associations between sentiments expressed in comments and LTR responses. However, comments about telemedicine were relatively poor predictors for LTR compared to comments about the provider. Discussion: NPS, which is included on many patient experience surveys used by health systems across the United States, has limitations for use as a measure of the acceptability of telemedicine for patients. Patients have more than telemedicine in mind when responding to the LTR question, and ratings conflate attitudes about providers, office policies, and staff with the telemedicine modality. More direct measures are necessary for meaningful research on the acceptability and usability of telemedicine for patients.
Collapse
Affiliation(s)
- Mike Kohut
- Center for Interdisciplinary Population and Health Research, MaineHealth Institute for Research, Scarborough, Maine, USA
- Department of Public Health and Community Medicine, Tufts University School of Medicine, Boston, Massachusetts, USA
| | - Tracy Jalbuena
- MaineHealth Telehealth, MaineHealth, Portland, Maine, USA
| | - Rachel Alfiero
- MaineHealth Telehealth, MaineHealth, Portland, Maine, USA
| | - John DiPalazzo
- Center for Interdisciplinary Population and Health Research, MaineHealth Institute for Research, Scarborough, Maine, USA
- Department of Public Health and Community Medicine, Tufts University School of Medicine, Boston, Massachusetts, USA
| | - Eric Anderson
- Center for Interdisciplinary Population and Health Research, MaineHealth Institute for Research, Scarborough, Maine, USA
- Department of Public Health and Community Medicine, Tufts University School of Medicine, Boston, Massachusetts, USA
| | - Jasmine Bishop
- MaineHealth Telehealth, MaineHealth, Portland, Maine, USA
| |
Collapse
|
2
|
Halajyan CP, Thomas J, Xu B, Gluckstein J, Jiang X. Telemedicine in Eye Care During the COVID-19 Pandemic: A Review of Patient & Physician Perspectives. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.10.25.24316160. [PMID: 39502667 PMCID: PMC11537333 DOI: 10.1101/2024.10.25.24316160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/13/2024]
Abstract
Purpose There has been an increase in the adoption of telemedicine during the COVID-19 pandemic. This review used systematic search and review criteria to assess the literature on patient and physician perspectives toward telemedicine for vision care during the pandemic. Methods We conducted a comprehensive search on PubMed, Embase, and Scopus using relevant MeSH terms to identify peer-reviewed studies examining telemedicine use in eye care during the pandemic. The search strategy encompassed three key concepts: COVID-19 or pandemic, telehealth or telemedicine, and eye care. Further screening of references and similar articles was conducted to identify additional relevant studies. Results We identified 24 relevant studies published between 2020 and 2022. Of these, 15 focused on patients' perspectives, while 12 explored physicians' perspectives. Predominantly cross-sectional in design, these studies were mainly conducted during the initial wave of the pandemic (March 2020 to June 2020), primarily in urban locations and hospital settings. Patients were satisfied with telemedicine and considered it equally effective to in-person visits. Patients believed telemedicine was convenient, improved eye care access, and a beneficial triage tool. Physicians acknowledged telemedicine's convenience for follow-up assessment and its ability to expand the capacity for emergency cases. However, both patients and physicians voiced concerns about the absence of ancillary examination and technological challenges. Conclusion Our review highlights the positive impact of telemedicine in eye care during the pandemic. Nonetheless, most studies were limited in sample size. They did not delve into potential disparities based on race/ethnicity, socioeconomic status, and geographic location, factors that could influence patient attitudes toward telemedicine. Further research is warranted to validate the findings from our selected studies and explore factors that influence the implementation of telemedicine, particularly across various eye care subspecialties.
Collapse
Affiliation(s)
- Christina Perjuhi Halajyan
- Department of Population and Public Health Sciences, University of Southern California Keck School of Medicine, Los Angeles, CA, United States
| | | | - Benjamin Xu
- Department of Ophthalmology, University of Southern California Keck School of Medicine, Los Angeles, CA, United States
| | - Jeffrey Gluckstein
- Department of Ophthalmology, University of Southern California Keck School of Medicine, Los Angeles, CA, United States
| | - Xuejuan Jiang
- Department of Population and Public Health Sciences, University of Southern California Keck School of Medicine, Los Angeles, CA, United States
- Department of Ophthalmology, University of Southern California Keck School of Medicine, Los Angeles, CA, United States
| |
Collapse
|
3
|
Gotthardt CJ, Haynes SC, Murphy RK, Marcin P. Patient and Parent Experience with Pediatric Care Providers During the COVID-19 Pandemic: A Comparison of Press Ganey Survey Scores for Telehealth and In-Person Encounters. Telemed J E Health 2024; 30:1825-1833. [PMID: 38512471 DOI: 10.1089/tmj.2024.0055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/23/2024] Open
Abstract
Background: Prior research suggests that pediatric patients and their parents/guardians are generally satisfied with care provided through telehealth. The objective of this study was to compare Press Ganey provider-oriented experience survey scores between telehealth and in-person patient encounters among a variety of pediatric clinical specialties at a large academic medical center. Methods: We analyzed Press Ganey survey data from pediatric patient encounters from UC Davis Health, collected between August 2020 and February 2022. Survey results analyzed respondents' satisfaction with care providers, including satisfaction with explanations given, discussions led, concern showed, and inclusion by providers; and the likelihood the survey respondent would recommend the provider to others. We used logistic regression models, which included case mix variables and clinical specialty to compare the odds of scoring the highest possible survey response ("top box" score). Results: Of the 6,093 survey responses that met inclusion criteria, 1,157 (19%) were associated with telehealth encounters and 4,936 (81%) were associated with in-person encounters. We found no significant difference in the odds of respondents giving a top box score to rate their satisfaction with their care provider between telehealth and in-person encounters. When respondents were asked whether they would recommend the care provider to others, the odds of giving a top box score following a telehealth encounter relative to an in-person encounter was 1.22 (95% confidence interval [0.97-1.52]; p-value = 0.09). Discussion: We found that survey respondents' experiences with their care provider are high and comparable for telehealth and in-person encounters in a pediatric population.
Collapse
Affiliation(s)
- Christine J Gotthardt
- Department of Pediatrics, Davis School of Medicine, University of California, Sacramento, California, USA
| | - Sarah C Haynes
- Department of Pediatrics, Davis School of Medicine, University of California, Sacramento, California, USA
| | - Riley K Murphy
- University of California Davis Health, Sacramento, California, USA
| | - P Marcin
- Department of Pediatrics, Davis School of Medicine, University of California, Sacramento, California, USA
| |
Collapse
|
4
|
Jia Q, Wang X, Li X, Xie C, Zhang Q, Mu J, Yang W. Analysis of research hotspots and trends in pediatric ophthalmopathy based on 10 years of WoSCC literature. Front Pediatr 2024; 12:1405110. [PMID: 38873588 PMCID: PMC11171143 DOI: 10.3389/fped.2024.1405110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 05/20/2024] [Indexed: 06/15/2024] Open
Abstract
Background Ophthalmopathy occurring in childhood can easily lead to irreversible visual impairment, and therefore a great deal of clinical and fundamental researches have been conducted in pediatric ophthalmopathy. However, a few studies have been performed to analyze such large amounts of research using bibliometric methods. This study intended to apply bibliometric methods to analyze the research hotspots and trends in pediatric ophthalmopathy, providing a basis for clinical practice and scientific research to improve children's eye health. Methods Publications related to pediatric ophthalmopathy were searched and identified in the Web of Science Core Collection (WoSCC) database. Bibliometric and visualized analysis was performed using the WoSCC analysis system and CiteSpace.6.2.6 software, and high-impact publications were analyzed. Results This study included a total of 7,177 publications from 162 countries and regions. Of these, 2,269 from the United States and 1,298 from China. The centrality and H-index were highest in the United States at 0.27 and 66, respectively. The University of London and Harvard University had the highest H-index at 37. Freedman,Sharon F published 55 publications, with the highest H-index at 19. The emerging burst keyword in 2020-2023 was "eye tracking," and the burst keywords in 2021-2023 were "choroidal thickness," "pediatric ophthalmology," "impact" and "childhood glaucoma." Retinopathy of prematurity, myopia, retinoblastoma and uveitis in juvenile idiopathic arthritis were the main topics in the high-impact publications, with clinical studies in the majority, especially in retinopathy of prematurity. Conclusion Eye health in children is a research hotspot, with the United States publishing the largest number of papers and having the greatest influence in research on pediatric ophthalmopathy, and China coming in second. The University of London and Stanford University had the greatest influence. Freedman, Sharon F was the most influential author. Furthermore, "choroidal thickness," "pediatric ophthalmology," "impact," "childhood glaucoma" and "eye tracking"are the latest hotspots in the field of pediatric ophthalmopathy. These hotspots represent hot diseases, hot technologies and holistic concepts, which are exactly the research trends in the field of pediatric ophthalmopathy, providing guidance and grounds for clinical practice and scientific research on children's eye health.
Collapse
Affiliation(s)
- Qianfang Jia
- Department of Children Rehabilitation, First Affiliated Hospital of Xinxiang Medical University, Xinxiang, China
- Xinxiang Autism Integration Education Engineering Technology Research Center, Xinxiang, China
| | - Xiaofang Wang
- Hebei University of Chinese Medicine, Shijiazhuang, China
| | - Xiwan Li
- Department of Children Rehabilitation, First Affiliated Hospital of Xinxiang Medical University, Xinxiang, China
| | - Cuijuan Xie
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen, China
| | - Qing Zhang
- The Third Affiliated Hospital of Xinxiang Medical University, Xinxiang Medical University, Xinxiang, China
| | - Jingfeng Mu
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen, China
| | - Weihua Yang
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen, China
| |
Collapse
|
5
|
Du Y, Gu Y. The development of evaluation scale of the patient satisfaction with telemedicine: a systematic review. BMC Med Inform Decis Mak 2024; 24:31. [PMID: 38303031 PMCID: PMC10832124 DOI: 10.1186/s12911-024-02436-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 01/22/2024] [Indexed: 02/03/2024] Open
Abstract
BACKGROUND Since the outbreak of the COVID-19 pandemic, telemedicine become more and more popular, patients attempt to use telemedicine to meet personal medical needs. Patient satisfaction is a key indicator of insight into the patient experience. PURPOSE This systematic review aims to explore the measurement factors of patient satisfaction with telemedicine and develop a more comprehensive and systematic scale of patient satisfaction with telemedicine. METHODS In February 2023, a literature search was conducted on the PubMed, EMBASE, and Web of Science, identifying measurement factors and tools of patient satisfaction with telemedicine. For inclusion, the studies had to have or make a questionnaire about patient satisfaction with telemedicine delivered through video/audio visits in English. The quality of the studies was evaluated according to the Critical Appraisal Tool for Analytical Cross-Sectional Studies of the Joanna Briggs Institute (JBI). The dimensions and items in each tool were also analyzed. RESULTS The initial search showed 14,020 studies. After eliminating duplicates and utilizing inclusion and exclusion criteria, 44 studies were included. This systematic review identified and integrated the measurement factors and develops a scale of patient satisfaction with telemedicine, which was divided into 9 dimensions and consists of 37 items. CONCLUSION Future measurement and evaluation of telemedicine will benefit from scale that was developed in this study, and it will more directly reflecting patient needs when patient satisfaction with telemedicine is evaluated.
Collapse
Affiliation(s)
- Yifei Du
- Department of Medical Information Technology and Management, Yanjing Medical College, Capital Medical University, Beijing, China
| | - Yu Gu
- Department of Medical Information Technology and Management, Yanjing Medical College, Capital Medical University, Beijing, China.
| |
Collapse
|
6
|
Than J, Sim PY, Muttuvelu D, Ferraz D, Koh V, Kang S, Huemer J. Teleophthalmology and retina: a review of current tools, pathways and services. Int J Retina Vitreous 2023; 9:76. [PMID: 38053188 PMCID: PMC10699065 DOI: 10.1186/s40942-023-00502-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Accepted: 10/02/2023] [Indexed: 12/07/2023] Open
Abstract
Telemedicine, the use of telecommunication and information technology to deliver healthcare remotely, has evolved beyond recognition since its inception in the 1970s. Advances in telecommunication infrastructure, the advent of the Internet, exponential growth in computing power and associated computer-aided diagnosis, and medical imaging developments have created an environment where telemedicine is more accessible and capable than ever before, particularly in the field of ophthalmology. Ever-increasing global demand for ophthalmic services due to population growth and ageing together with insufficient supply of ophthalmologists requires new models of healthcare provision integrating telemedicine to meet present day challenges, with the recent COVID-19 pandemic providing the catalyst for the widespread adoption and acceptance of teleophthalmology. In this review we discuss the history, present and future application of telemedicine within the field of ophthalmology, and specifically retinal disease. We consider the strengths and limitations of teleophthalmology, its role in screening, community and hospital management of retinal disease, patient and clinician attitudes, and barriers to its adoption.
Collapse
Affiliation(s)
- Jonathan Than
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Peng Y Sim
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Danson Muttuvelu
- Department of Ophthalmology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- MitØje ApS/Danske Speciallaeger Aps, Aarhus, Denmark
| | - Daniel Ferraz
- D'Or Institute for Research and Education (IDOR), São Paulo, Brazil
- Institute of Ophthalmology, University College London, London, UK
| | - Victor Koh
- Department of Ophthalmology, National University Hospital, Singapore, Singapore
| | - Swan Kang
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Josef Huemer
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK.
- Department of Ophthalmology and Optometry, Kepler University Hospital, Johannes Kepler University, Linz, Austria.
| |
Collapse
|
7
|
Telemedicine for Retinal Disease During the COVID-19 Pandemic: Survey of the Patient Perspective. Ophthalmol Ther 2022; 11:1925-1936. [PMID: 35922710 PMCID: PMC9362715 DOI: 10.1007/s40123-022-00555-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Accepted: 07/25/2022] [Indexed: 11/02/2022] Open
Abstract
INTRODUCTION Amidst the COVID-19 pandemic, telemedicine has emerged as a safe and cost-effective alternative to traditional ophthalmology clinic visits. This study evaluated patient attitudes towards telemedicine at a full-service, retina-only practice to identify areas for growth in implementation. METHODS A survey was distributed to established patients at University Retina and Macula Associates following the completion of a telemedicine encounter in July 2021. On a 5-point Likert scale, patients compared telemedicine to in-person visits for six domains: ability to ease COVID-related anxiety, efficiency, patient education, quality of care, fulfillment of personal needs, and convenience. Pearson's χ2 and Fisher's exact test were used to assess correlations between demographic factors and patient attitudes or preference towards telemedicine. RESULTS Among 103 respondents, two-thirds (68.7%) preferred in-person compared to telemedicine encounters. Overall, patients had a neutral attitude towards telemedicine [mean Likert rating (SD) = 3.11/5 ± 0.82]. Questions assessing "patient education" and "telemedicine efficiency" received the greatest proportion of positive and negative responses, respectively. Positive attitudes were more frequent among patients with prior telemedicine experience (87.5%) compared to never-users (71.8%; p = 0.046). Patients ≥ 75 years old tended to negatively assess telemedicine regarding reduction of COVID-19-related anxiety, efficiency, patient education, and physician facetime (p < 0.05 for all). A positive but non-significant trend was observed between higher education level and positive attitude towards telemedicine (p = 0.18). Telehealth never-users more often negatively rated receiving adequate facetime with the physician virtually (54.7%) compared to prior users (25.6%; p = 0.004). Younger age, prior history of telemedicine use, and higher education level were associated with increased preference for telemedicine (p < 0.05 for all). CONCLUSION Our findings revealed hesitance remains among patients towards adoption of telemedicine. Targeting age-, experience-, and education-related barriers will be invaluable for increasing acceptance of this healthcare delivery model.
Collapse
|
8
|
Bellsmith KN, Gale MJ, Yang S, Nguyen IB, Prentiss CJ, Nguyen LT, Mershon S, Summers AI, Thomas M. Validation of Home Visual Acuity Tests for Telehealth in the COVID-19 Era. JAMA Ophthalmol 2022; 140:465-471. [PMID: 35357405 PMCID: PMC8972145 DOI: 10.1001/jamaophthalmol.2022.0396] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 02/01/2022] [Indexed: 12/11/2022]
Abstract
Importance Visual acuity (VA) is one of the most important clinical data points in ophthalmology. However, few options for validated at-home VA assessments are currently available. Objective To validate 3 at-home visual acuity tests in comparison with in-office visual acuity. Design, Setting, and Participants Between July 2020 and April 2021, eligible participants with VA of 20/200 or better were recruited from 4 university-based ophthalmology clinics (comprehensive, cornea, glaucoma, and retina clinics). Participants were prospectively randomized to self-administer 2 of 3 at-home VA tests (printed chart, mobile phone app, and website) within 3 days before their standard-of-care clinic visit. Participants completed a survey assessing usability of the at-home tests. At the clinic visit, best-corrected Snellen distance acuity was measured as the reference standard. Main Outcomes and Measures The at-home VA test results were compared with the in-office VA test results using paired and unpaired t tests, Pearson correlation coefficients, analysis of variance, χ2 tests, and Cohen κ agreement. The sensitivity, specificity, positive predictive value, and negative predictive value of each at-home test were calculated to detect significant VA changes (≥0.2 logMAR) from the in-office baseline. Results A total of 121 participants with a mean (SD) age of 63.8 (13.0) years completed the study. The mean in-office VA was 0.11 logMAR (Snellen equivalent 20/25) with similar numbers of participants from the 4 clinics. Mean difference (logMAR) between the at-home test and in-office acuity was -0.07 (95% CI, -0.10 to -0.04) for the printed chart, -0.12 (95% CI, -0.15 to -0.09) for the mobile phone app, and -0.13 (95% CI, -0.16 to -0.10) for the website test. The Pearson correlation coefficient for the printed chart was 0.72 (95% CI, 0.62-0.79), mobile phone app was 0.58 (95% CI, 0.46-0.69), and website test was 0.64 (95% CI, 0.53-0.73). Conclusions and Relevance The 3 at-home VA test results (printed chart, mobile phone app, and website) appeared comparable within 1 line to in-office VA measurements. Older participants were more likely to have limited access to digital tools. Further development and validation of at-home VA testing modalities is needed with the expansion of teleophthalmology care.
Collapse
Affiliation(s)
| | - Michael J. Gale
- Casey Eye Institute, Oregon Health & Science University, Portland
| | - Sen Yang
- Casey Eye Institute, Oregon Health & Science University, Portland
| | | | | | - Luan T. Nguyen
- Casey Eye Institute, Oregon Health & Science University, Portland
| | - Sam Mershon
- Casey Eye Institute, Oregon Health & Science University, Portland
| | | | - Merina Thomas
- Casey Eye Institute, Oregon Health & Science University, Portland
| |
Collapse
|