Quantifying Patient Portal Use: Systematic Review of Utilization Metrics

Assessing the acceptability of using patient portals to recruit pregnant women and new mothers for maternal-child health research

Objective

Electronic patient portals (PP) allow for targeted and efficient research recruitment. We assessed pre- and postnatal women's recruitment methods preferences, focusing on PP.

Materials and Methods

We conducted 4 in-person focus groups with new and expecting mothers. Participants reported demographics, health status, and comfort with technology including PP. We used descriptive statistics to characterize quantitative data and a quasi-deductive approach to analyze qualitative data.

Results

Participants (n = 32) were an average age of 31.9 years, mostly White (65.6%), married (90.6%), and had a 4-year degree or higher (71.9%). Although they preferred PP for research recruitment over other methods (eg, in-person, physical mail), participants suggested potential barriers, including high message frequency, messages feeling like spam, and concerns about confidentiality. Participants suggested solutions, including enhancing autonomy through opt-in methods; integrating their healthcare provider's feedback; sending personal and relevant messages; and assuring their PP data are confidential.

Discussion

PPs are a promising recruitment method for pre- and postnatal women including for maternal-child health studies. To ensure engagement with the method, researchers must respond to known patient concerns and incorporate their feedback into future efforts.

Conclusion

Although PP were generally viewed as an acceptable recruitment method, researchers should be mindful of barriers that may limit its reach and effectiveness.

Taming the In-Basket-How Two Simple Tools Reduced Portal Message Volume in an Academic Internal Medicine Clinic

BACKGROUND

Patient portal messaging has emerged as a critical tool in primary care, particularly during the COVID-19 pandemic, facilitating asynchronous communication between patients and providers. The surge in portal messages during the pandemic has exacerbated work overload and burnout among primary care providers.

OBJECTIVE

To enhance primary care clinic portal message workflow efficiency by identifying barriers through surveys and interviews, then implementing interventions to address challenges and streamline processes.

DESIGN

We used a pre- and post-intervention with concurrent control design to evaluate this quality improvement project. The project was conducted at an Internal Medicine ambulatory clinic site within a large academic medical center in the Midwest.

PARTICIPANTS

The quality improvement project involved primary care physicians, registered nurses, licensed practical nurses, medical assistants, and patient services associates managing patient portal messages in primary care clinics.

INTERVENTION

Interviews and surveys assessed workflow practices, perceptions, and gaps. Interventions included developing "Best Practice Standards" and "Routing Guide" documents and restructuring staffing with dedicated time for message management.

MAIN MEASURES

The co-primary outcomes were the volume of portal messages per physician clinical full-time equivalent (cFTE) and the proportion of message encounters with physician involvement. The secondary outcome was the proportion of messages sent to multiple recipients ("carbon copy" messages).

KEY RESULTS

The intervention site showed a 16% reduction in messages per physician cFTE monthly (RRR, 0.84; 95% CI, 0.75-0.94) and a 65% decrease in "carbon copy" messages (RR, 0.35; 95% CI, 0.31-0.39) compared to controls. Physician involvement in messages remained unchanged at the intervention site but increased 8% at control sites. Pre-intervention interviews identified workload, process, training, and stress barriers. Post-intervention, staff noted improvements from role clarification and dedicated message time.

CONCLUSION

Targeted interventions can reduce portal message burden and improve workflow efficiency in primary care by implementing standardized protocols and clarifying roles.

Patient Factors Associated With the Use of Online Portal Health Information in the Postpandemic Era: Cross-Sectional Analysis of a National Survey

BACKGROUND

Patients' electronic access to their health information can improve long-term health outcomes. Few studies have evaluated barriers that may limit access to portal health information before the COVID-19 pandemic such as preference for in-person visits, lack of perceived need to use a patient portal system, and lack of comfort or experience with computers. With the increased use of telehealth during the pandemic, patients' comfort with portal applications and digital health literacy has improved.

OBJECTIVE

The purpose of this study was to assess the prevalence of portal use and factors associated with patients' portal access after the COVID-19 pandemic.

METHODS

This study used data from the 2022 National Cancer Institute's Health Information National Trends Survey (HINTS 6). Adult patients (aged ≥18 years) who responded to the survey question about patient portal access were included. A multivariate logistic regression analysis was performed to determine characteristics associated with portal access.

RESULTS

A total number of 5958 patients were included (weighted n=245,721,106), with a mean age of 48.2 (20.1) years and were mostly female (119,538,392/236,138,857, 50.6%) and white (167,163,482/227,232,636, 73.6%). Overall, 61.3% (150,722,178/245,721,106) of all respondents reported accessing portals over the last 12 months and 43.7% (82,620,907/188,860,031) used multiple portals. Most participants (135,011,661/150,104,795, 89.9%) reported using portals to access test results, followed by viewing clinical notes (104,541,142/149,867,276, 69.8%) downloading personal health information (47,801,548/150,017,130, 31.9%). The likelihood of portal use significantly increased by 24.9% points (95% CI 19.4-30.5) when patients were offered access to portals by health care providers or insurers compared with those not offered access or did not know if they were offered access. The likelihood of portal use also increased by 19.5% points (95% CI 15.1-23.9) among patients with a health care provider encouraging them to access portals, compared to patients who did not receive encouragement to do so. Having a college education versus education below college level and living in metropolitan areas versus nonmetropolitan regions increased the probability of portal use by 6.9% points (95% CI 3.1-10.8) and 6.9% points (95% CI 1.3-12.6), respectively. Of note, males (compared with females) and those of Hispanic background (compared with non-Hispanic individuals) were less likely to be offered portal access by 10.8% points (95% CI 6.3-15.2) and 6.9% points (95% CI 1.7-12.1), respectively.

CONCLUSIONS

This study demonstrates that most Americans use patient portals, though certain patient populations such as those with less than college degree education or living in nonmetropolitan areas continue to face greater difficulty accessing them. Interventions targeted at equality in offering access to patient portals and encouraging patients to use them could advance equitable and widespread access to patient portals.

Multilevel Intervention to Increase Patient Portal Use in Adults With Type 2 Diabetes Who Access Health Care at Community Health Centers: Single Arm, Pre-Post Pilot Study

BACKGROUND

Diabetes self-management education and support (DSMS) delivered via patient portals significantly improves glycemic control. Yet, disparities in patient portal use persist. Community health centers (CHCs) deliver care to anyone who needs it, regardless of income or insurance status.

OBJECTIVE

This study aimed to evaluate the feasibility, acceptability, and preliminary efficacy of a multilevel intervention to increase access and use of portals (MAP) among people with type 2 diabetes (T2D) receiving health care at CHCs.

METHODS

A within-subjects, pre-post design was used. Adults with T2D who were portal naive were recruited from 2 CHCs. After informed consent, participants met with a community health worker for referrals for social determinants of health, provision of a tablet with cell service, and individualized training on use of the tablet and portal. Next, a nurse met individually with participants to develop a DSMS plan and then communicated with patients via the portal at least twice weekly during the first 3 months and weekly for the latter 3 months. Data were collected at baseline, 3 months and 6 months. The primary outcome was patient activation and engagement with the portal. Secondary outcomes included technology attitudes, digital health literacy, health-related outcomes and psychosocial function.

RESULTS

In total, 26 patients were eligible, 23 received the intervention, and one was lost to follow up. The sample was predominately Latino or Hispanic (17/22, 77%) and reported low income (19/22, 86%< US $40,000/year), low education (13/22, 59%

CONCLUSIONS

MAP shows promise for improving health equity in portal use for T2D. Larger, controlled studies are needed to determine how best to implement MAP in complex clinical settings and to evaluate efficacy over time.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05180721; https://clinicaltrials.gov/study/NCT05180721.

Collapse

Key Words

• CHCs
• DM
• T2D
• Type 2 diabetes
• adults
• community health center
• community health centers
• diabetes
• diabetes mellitus
• diabetic
• digital health
• digital health literacy
• efficacy
• feasibility
• glycemic control
• health technologies
• health technology
• mobile phone
• patient portal
• patient portals
• pilot study
• primary outcome
• psychosocial
• self-management
• social determinants of health

Collapse

MESH Headings

• Humans
• Diabetes Mellitus, Type 2/therapy
• Diabetes Mellitus, Type 2/psychology
• Male
• Female
• Patient Portals/statistics & numerical data
• Middle Aged
• Pilot Projects
• Community Health Centers/statistics & numerical data
• Health Services Accessibility/statistics & numerical data
• Aged
• Adult
• Patient Education as Topic/methods
• Self-Management/education
• Feasibility Studies

Collapse

Grants

• R21 MD016949 NIMHD NIH HHS

Collapse

Affiliation(s)

Robin Whittemore School of Nursing, Yale University, Orange, CT, United States
Sangchoon Jeon School of Nursing, Yale University, Orange, CT, United States
Samuel Akyirem School of Nursing, Yale University, Orange, CT, United States
Helen N C Chen Department of Epidemiology, Richard M. Fairbanks School of Public Health, Indiana University, Indianapolis, IN, United States
Joanna Lipson School of Nursing, Yale University, Orange, CT, United States
Maritza Minchala School of Public Health, Yale University, New Haven, CT, United States
Julie Wagner Department of Behavioral Sciences and Community Health, University of Connecticut School of Dental Medicine, Farmington, CT, United States

Collapse

Collaborators Collapse

Identification and Classification Features of Patient Portal, A Systematic Review

Background and Aims

According to different theories in the field of using web technologies, it can be said that portals are one of the most appropriate tools to facilitate the process of care, communication, and education. Therefore, this systematic review aims to identify the features and functions of health portals that are critical for the success and widespread use of patient web-based portals.

Methods

On August 28, 2022, a systematic search was conducted without a time limit in PubMed, Embase, Scopus, and Web of Science databases. Preferential reporting guidelines for systematic review and meta-analysis studies were followed. Titles and abstracts were independently screened based on eligibility criteria. The checklist was used for data extraction, and finally, started to identify the functional features of patient portals based on the review of retrieved articles.

Results

We retrieved 1561 articles after initial screening and removing duplicate articles. After reviewing the title and abstract of the articles and applying the inclusion and exclusion criteria, finally, 22 articles were selected for full-text review. The required data were extracted based on the checklist designed for this purpose. A total of 186 features were obtained for the design of the patient portal, which led to the identification of 6 main structural features and 30 content features for the design of the portal.

Conclusion

Identifying the structural and content features of patient portals can help healthcare providers and organizations in designing patient portals according to the needs of patients and considering the requirements comprehensively.

Digital Information Exchange Between the Public and Researchers in Health Studies: Scoping Review

BACKGROUND

Information exchange regarding the scope and content of health studies is becoming increasingly important. Digital methods, including study websites, can facilitate such an exchange.

OBJECTIVE

This scoping review aimed to describe how digital information exchange occurs between the public and researchers in health studies.

METHODS

This scoping review was prospectively registered and adheres to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Eligibility was defined using the population (public and researchers), concept (digital information exchange), and context (health studies) framework. Bibliographic databases (MEDLINE, PsycINFO, CINAHL, and Web of Science), bibliographies of the included studies, and Google Scholar were searched up to February 2024. Studies published in peer-reviewed journals were screened for inclusion based on the title, abstract, and full text. Data items charted from studies included bibliographic and PCC (Population, Concept, and Context) characteristics. Data were processed into categories that inductively emerged from the data and were synthesized into main themes using descriptive statistics.

RESULTS

Overall, 4072 records were screened, and 18 studies published between 2010 and 2021 were included. All studies evaluated or assessed the preferences for digital information exchange. The target populations included the public (mainly adults with any or specific diseases), researchers, or both. The digital information exchange methods included websites, emails, forums, platforms, social media, and portals. Interactivity (ie, if digital information exchange is or should be active or passive) was addressed in half of the studies. Exchange content included health information or data with the aim to inform, recruit, link, or gather innovative research ideas from participants in health studies. We identified 7 facilitators and 9 barriers to digital information exchange. The main facilitators were the consideration of any stakeholder perspectives and needs to clarify expectations and responsibilities, the use of modern or low-cost communication technologies and public-oriented language, and continuous communication of the health study process. The main barriers were that information exchange was not planned or not feasible due to inadequate resources, highly complex technical language was used, and ethical concerns (eg, breach of anonymity if study participants are brought together) were raised. Evidence gaps indicate that new studies should assess the methods and the receiver (ie, public) preferences and needs that are required to deliver and facilitate interactive digital information exchange.

CONCLUSIONS

Few studies addressing digital information exchange in health studies could be identified in this review. There was little focus on interactivity in such an exchange. Digital information exchange was associated with more barriers than facilitators, suggesting that more effort is required to improve such an exchange between the public and researchers. Future studies should investigate interactive digital methods and the receiver preferences and needs required for such an exchange.

Insights and Trends in Open Note Access: Retrospective Observational Study

BACKGROUND

As of 2021, at least 4 out of every 5 hospitals offered patients access to clinical notes via a web-based patient portal, a number that is expected to grow because of the 21st Century Cures Act. There is limited data on how open note use may have evolved over time or which types of clinical interactions were viewed most in the outpatient setting.

OBJECTIVE

This study aims to analyze trends in outpatient open note access over time; characterize usage in terms of age, sex, and clinical interaction type; and assess the method of access to help uncover areas of improvement in patient engagement and identify further areas of research.

METHODS

A retrospective observational study was conducted at Erie County Medical Center from November 1, 2021, to December 31, 2022, to coincide with the time that open notes went live. Outpatient note access and account logs were downloaded from the portal and combined into a single dataset consisting of 18,384 note accesses by 4615 users, with column headings of the patient index, sex, age, note title that was accessed, clinical interaction type, time stamp of note creation, time stamp of access, and method of access (web vs mobile). A separate table was created with sex data for all 35,273 portal accounts. Microsoft Excel and Microsoft Power Query were used to combine and analyze the data.

RESULTS

During the study period, 4615 portal users viewed 12,150 documents for a total of 18,384 times, averaging 2.6 notes per patient viewed 4 times. Only 13.1% (4615/35,273) of all portal inpatient and outpatient registrants viewed their outpatient notes. There was a female predominance in those who viewed notes (2926/4615, 63.4%; P<.001), while 56.8% (20,047/35,273) of all portal registrants were female. Users in their 30s and 50s accessed more notes than other age groups. The ratio of mobile-to-web access of notes tended to decrease as a function of increasing age, which was not observed in those aged ≥90 years. Notes regarding COVID-19 assessments were the most accessed among all clinical interactions (4725/12,150, 38.9%). Overall, the number of users accessing notes reached a maximum of 1968 before declining to 1027 by the end of the study period.

CONCLUSIONS

Open note access was largely dominated by COVID-19 assessments, and the number of users viewing their notes has declined over time as the pandemic subsided. Furthermore, female patients and those aged in their 30s as well as 50s viewed more notes than other groups. Finally, the percentage of notes viewed via a mobile device tended to decrease as a function of increasing age, showing that web-based access of open notes is an important modality for older patients.

Development and application of Breadth-Depth-Context (BDC), a conceptual framework for measuring technology engagement with a qualified clinical data registry

Objectives

Despite the proliferation of dashboards that display performance data derived from Qualified Clinical Data Registries (QCDR), the degree to which clinicians and practices engage with such dashboards has not been well described. We aimed to develop a conceptual framework for assessing user engagement with dashboard technology and to demonstrate its application to a rheumatology QCDR.

Materials and Methods

We developed the BDC (Breadth-Depth-Context) framework, which included concepts of breadth (derived from dashboard sessions), depth (derived from dashboard actions), and context (derived from practice characteristics). We demonstrated its application via user log data from the American College of Rheumatology's Rheumatology Informatics System for Effectiveness (RISE) registry to define engagement profiles and characterize practice-level factors associated with different profiles.

Results

We applied the BDC framework to 213 ambulatory practices from the RISE registry in 2020-2021, and classified practices into 4 engagement profiles: not engaged (8%), minimally engaged (39%), moderately engaged (34%), and most engaged (19%). Practices with more patients and with specific electronic health record vendors (eClinicalWorks and eMDs) had a higher likelihood of being in the most engaged group, even after adjusting for other factors.

Discussion

We developed the BDC framework to characterize user engagement with a registry dashboard and demonstrated its use in a specialty QCDR. The application of the BDC framework revealed a wide range of breadth and depth of use and that specific contextual factors were associated with nature of engagement.

Conclusion

Going forward, the BDC framework can be used to study engagement with similar dashboards.

Can Digital Health Improve Therapeutic Compliance in Oncology?

PURPOSE

Therapeutic compliance, or adherence, is critical in oncology because of the complexity and duration of cancer treatment regimens. Nonadherence can lead to suboptimal therapeutic outcomes, increased disease progression, higher mortality rates, and elevated health care costs. Traditional methods to enhance compliance, such as patient education and regular follow-ups, have shown limited success.

MATERIALS AND METHODS

This review examines the potential of digital health technologies to improve adherence in oncology. Various studies and trials are analyzed to assess the effectiveness of these technologies in supporting patients with cancer.

RESULTS

mHealth applications have been shown to improve medication adherence through features like medication reminders and symptom tracking. Telemedicine facilitates continuous care and reduces the need for travel, significantly improving adherence and patient satisfaction. Patient-reported outcome measures enhance clinical decision making and personalized treatment plans by incorporating patient feedback. Electronic medical records and patient portals improve compliance by providing easy access to medical information and fostering better patient-provider communication. Connected pillboxes aid in consistent medication intake and reduce dispensing errors.

CONCLUSION

Digital health technologies offer significant benefits in oncology by enhancing patient engagement, improving adherence to treatment protocols, and enabling comprehensive cancer care management. However, challenges such as the digital divide, data privacy concerns, and the need for tailored interventions must be addressed. Future research should focus on evaluating the effectiveness of digital interventions and developing personalized digital health tools to maximize therapeutic compliance.

Patterns of digital health access and use among US adults: A latent class analysis

Background

Digital technologies allow users to engage in health-related behaviors associated with positive outcomes. We aimed to identify classes of US adults with distinct digital technologies access and health use patterns and characterize class composition. Data came from Health Information National Trends Survey Wave 5 Cycles 1-4, a nationally representative cross-sectional survey of US adults (N=13,993). We used latent class analysis to identify digital technologies access and health use patterns based on 32 ternary variables of behaviors and access to requisite technologies and platforms, including the internet, internet-enabled devices, health monitors, and electronic health records (EHRs). We ran a multinomial logistic regression to identify sociodemographic and health correlates of class membership (n=10,734).

Results

Ten classes captured patterns of digital technology access and health use among US adults. This included a digitally isolated, a mobile-dependent, and a super user class, which made up 8.9%, 7.8%, and 13.6% of US adults, respectively, and captured access patterns from only basic cellphones and health monitors to near complete access to web-, mobile-, and EHR-based platforms. Half of US adults belonged to classes that lacked access to EHRs and relied on alternative web-based tools typical of patient portals. The proportion of class members who used digital technologies for health purposes varied from small to large. Older and less educated adults had lower odds of belonging to classes characterized by access or engagement in health behaviors. Hispanic and Asian adults had higher odds of belonging to the mobile-dependent class. Individuals without a regular healthcare provider and those who had not visited a provider in the past year were more likely to belong to classes with limited digital technologies access or health use.

Discussion

Only one third of US adults belonged to classes that had near complete access to digital technologies and whose members engaged in almost all health behaviors examined. Sex, age, and education were associated with membership in classes that lacked access to 1+ digital technologies or exhibited none to limited health uses of such technologies. Results can guide efforts to improve access and health use of digital technologies to maximize associated health benefits and minimize disparities.

A system-wide approach to digital equity: the Digital Access Coordinator program in primary care

INTRODUCTION

The transition to digital tools prompted by the pandemic made evident digital disparities. To address digital literacy gaps, we implemented a system-wide digital navigation program.

METHODS

The Digital Access Coordinator (DAC) program consists of 12 multilingual navigators who support patients in enrolling and using the patient portal and digital tools. We implemented the program in our primary care network which consists of 1.25 million patients across 1211 clinicians.

RESULTS

From May 2021 to November 2022, the DACs completed outreach to 16 045 patients. Of the 13 413 patients they reached, they successfully enrolled 8193 (61%) patients in the patient portal. Of those patients they enrolled, most patients were of Other race, Hispanic ethnicity, and were English-speaking (44%) and Spanish-speaking patients (44%). Using our embedded model, we increased enrollment across 7 clinics (mean increase: 21.3%, standard deviation: 9.2%). Additionally, we identified key approaches for implementing a digital navigation program.

CONCLUSION

Organizations can support patient portal enrollment, a key part of digital health equity, by creating and prioritizing digital navigation programs.

Real-Time Electronic Patient Portal Use Among Emergency Department Patients

Importance

Patients with inequitable access to patient portals frequently present to emergency departments (EDs) for care. Little is known about portal use patterns among ED patients.

Objectives

To describe real-time patient portal usage trends among ED patients and compare demographic and clinical characteristics between portal users and nonusers.

Design, Setting, and Participants

In this cross-sectional study of 12 teaching and 24 academic-affiliated EDs from 8 health systems in California, Connecticut, Massachusetts, Ohio, Tennessee, Texas, and Washington, patient portal access and usage data were evaluated for all ED patients 18 years or older between April 5, 2021, and April 4, 2022.

Exposure

Use of the patient portal during ED visit.

Main Outcomes and Measures

The primary outcomes were the weekly proportions of ED patients who logged into the portal, viewed test results, and viewed clinical notes in real time. Pooled random-effects models were used to evaluate temporal trends and demographic and clinical characteristics associated with real-time portal use.

Results

The study included 1 280 924 unique patient encounters (53.5% female; 0.6% American Indian or Alaska Native, 3.7% Asian, 18.0% Black, 10.7% Hispanic, 0.4% Native Hawaiian or Pacific Islander, 66.5% White, 10.0% other race, and 4.0% with missing race or ethnicity; 91.2% English-speaking patients; mean [SD] age, 51.9 [19.2] years). During the study, 17.4% of patients logged into the portal while in the ED, whereas 14.1% viewed test results and 2.5% viewed clinical notes. The odds of accessing the portal (odds ratio [OR], 1.36; 95% CI, 1.19-1.56), viewing test results (OR, 1.63; 95% CI, 1.30-2.04), and viewing clinical notes (OR, 1.60; 95% CI, 1.19-2.15) were higher at the end of the study vs the beginning. Patients with active portal accounts at ED arrival had a higher odds of logging into the portal (OR, 17.73; 95% CI, 9.37-33.56), viewing test results (OR, 18.50; 95% CI, 9.62-35.57), and viewing clinical notes (OR, 18.40; 95% CI, 10.31-32.86). Patients who were male, Black, or without commercial insurance had lower odds of logging into the portal, viewing results, and viewing clinical notes.

Conclusions and Relevance

These findings suggest that real-time patient portal use during ED encounters has increased over time, but disparities exist in portal access that mirror trends in portal usage more generally. Given emergency medicine's role in caring for medically underserved patients, there are opportunities for EDs to enroll and train patients in using patient portals to promote engagement during and after their visits.

Disparities in electronic health record portal access and use among patients with cancer

BACKGROUND

Electronic health record-linked portals may improve health-care quality for patients with cancer. Barriers to portal access and use undermine interventions that rely on portals to reduce cancer care disparities. This study examined portal access and persistence of portal use and associations with patient and structural factors before the implementation of 3 portal-based interventions within the Improving the Management of symPtoms during And following Cancer Treatment (IMPACT) Consortium.

METHODS

Portal use data were extracted from electronic health records for the 12 months preceding intervention implementation. Sociodemographic factors, mode of accessing portals (web vs mobile), and number of clinical encounters before intervention implementation were also extracted. Rurality was derived using rural-urban commuting area codes. Broadband access was estimated using the 2015-2019 American Community Survey. Multiple logistic regression models tested the associations of these factors with portal access (ever accessed or never accessed) and persistence of portal use (accessed the portal ≤20 weeks vs ≥21 weeks in the 35-week study period).

RESULTS

Of 28 942 eligible patients, 10 061 (35%) never accessed the portal. Male sex, membership in a racial and ethnic minority group, rural dwelling, not working, and limited broadband access were associated with lower odds of portal access. Younger age and more clinical encounters were associated with higher odds of portal access. Of those with portal access, 25% were persistent users. Using multiple modalities for portal access, being middle-aged, and having more clinical encounters were associated with persistent portal use.

CONCLUSION

Patient and structural factors affect portal access and use and may exacerbate disparities in electronic health record-based cancer symptom surveillance and management.

Disparities in Patient Portal Use Among Adults With Chronic Conditions

Importance

Disparities in patient access and use of health care portals have been documented. Limited research has evaluated disparities in portal use during and after the COVID-19 pandemic.

Objective

To assess prevalence of health care portal use before, during, and after the most restrictive phase of the pandemic (2019-2022) among the COVID-19 & Chronic Conditions (C3) cohort and to investigate any disparities in use by sociodemographic factors.

Design, Setting, and Participants

This cohort study uses data from the C3 study, an ongoing, longitudinal, telephone-based survey of participants with multiple chronic conditions. Participants were middle aged and older-adult primary care patients who had an active portal account, recruited from a single academic medical center in Chicago, Illinois, between 2019 and 2022. Data were analyzed between March and June 2022.

Main Outcomes and Measures

Outcomes of portal use (ie, number of days of portal login by year) were recorded for all study participants by the electronic data warehouse. All parent studies had uniform sociodemographic data and measures of social support, self-efficacy, health literacy, and health activation.

Results

Of 536 participants (mean [SD] age, 66.7 [12.0] years; 336 [62.7%] female), 44 (8.2%) were Hispanic or Latinx, 142 (26.5%) were non-Hispanic Black, 322 (60.1%) were non-Hispanic White, and 20 individuals (3.7%) identified as other race, including Asian, Native American or Alaskan Native, and self-reported other race. In multivariable analyses, portal login activity was higher during the 3 years of the COVID-19 pandemic compared with the 2019 baseline. Higher portal login activity was associated with adequate health literacy (incidence rate ratio [IRR], 1.51; 95% CI, 1.18-1.94) and multimorbidity (IRR, 1.38; 95% CI, 1.17-1.64). Lower portal activity was associated with older age (≥70 years: IRR, 0.69; 95% CI, 0.55-0.85) and female sex (IRR, 0.77; 95% CI, 0.66-0.91). Compared with non-Hispanic White patients, lower portal activity was observed among Hispanic or Latinx patients (IRR, 0.66; 95% CI, 0.49-0.89), non-Hispanic Black patients (IRR, 0.68; 95% CI, 0.56-0.83), and patients who identified as other race (IRR, 0.42; 95% CI, 0.28-0.64).

Conclusions and Relevance

This cohort study using data from the C3 study identified changes in portal use over time and highlighted populations that had lower access to health information. The COVID-19 pandemic was associated with an increase in portal use. Sociodemographic disparities by sex and age were reduced, although disparities by health literacy widened. A brief validated health literacy measure may serve as a useful digital literacy screening tool to identify patients who need further support.

Patterns of digital health access and use among US adults: A latent class analysis

Background Digital technologies allow users to engage in health-related behaviors associated with positive outcomes. We aimed to identify classes of US adults with distinct digital technologies access and health use patterns and characterize class composition. Data came from Health Information National Trends Survey Wave 5 Cycles 1-4, a nationally representative cross-sectional survey of US adults ( N  = 13,993). We used latent class analysis to identify digital technologies access and health use patterns based on 32 behaviors and access to requisite technologies and platforms that include the internet, internet-enabled devices, health monitors, and electronic health records (EHRs). We ran a multinomial logistic regression to identify sociodemographic and health correlates of class membership ( n  = 10,734). Results Ten classes captured patterns of digital technology access and health use among US adults. This included a digitally isolated, a mobile-dependent, and a super user class, which made up 8.9%, 7.8%, and 13.6% of US adults, respectively, and captured access patterns from only basic cellphones and health monitors to near complete access to web-, mobile-, and EHR-based platforms. Half of US adults belonged to classes that lacked access to EHRs and relied on alternative web-based tools typical of patient portals. The proportion of class members who used digital technologies for health purposes varied from small to large. Older and less educated adults had lower odds of belonging to classes characterized by access or engagement in health behaviors. Hispanic and Asian adults had higher odds of belonging to the mobile-dependent class. Individuals without a regular healthcare provider and those who had not visited a provider in the past year were more likely to belong to classes with limited digital technologies access or health use. Discussion Only one third of US adults belonged to classes that had near complete access to digital technologies and whose members engaged in almost all health behaviors examined. Sex, age, and education were associated with membership in classes that lacked access to 1 + digital technologies or exhibited none to limited health uses of such technologies. Results can guide efforts to improve access and health use of digital technologies to maximize associated health benefits and minimize disparities.

Direct and Indirect Care of Patients With Multiple Sclerosis: Burden on Providers and Impact of Portal Messages

BACKGROUND

Multiple sclerosis (MS) indirect patient-care time is often underreported and uncompensated. Data on time spent on indirect and direct care by MS providers is lacking.

METHODS

A survey was designed to understand the practice patterns among MS providers in the United States, including time spent on direct and indirect patient care, as well as managing electronic medical record portal messages. The National MS Society and the American Academy of Neurology facilitated the distribution of the survey to MS providers.

RESULTS

Most providers spent at least 1 hour on new and at least 30 minutes on follow-up direct patient care. For indirect patient care, 77% of providers spent more than 1 hour and 57% spent more than 2 hours per day. While some providers have support staff to help with portal messages, many do not have protected time or compensation for portal messages.

CONCLUSIONS

Multiple sclerosis providers spent a higher-than-average time on direct and indirect patient care tasks, including portal messages, and most lack protected time or compensation for portal messages. These results highlight the potential impact of indirect patient care (notably portal messages) on provider workload and burnout. Better support, protected time and/or compensation for indirect patient care can help ease physician burden and decrease burnout.

The Use of Navigators to Increase Patient Portal Enrollment among Patients in a Federally Qualified Health Care System

Purpose

To describe the training, preliminary results, and lessons learned from using patient navigators to increase the enrollment of low-income patients in a health system-supported and electronic health record-linked patient portal.

Methods

Patient navigators (n=4) were trained to assist patients in a federally qualified health center to enroll in and use patient portals. Patient navigators were stationed at 3 clinic locations. Data from the electronic health record system (Epic) were used to compare MyChart patient portal activation rates and use among patients for the 8 months before and after patient navigation services were offered.

Results

Navigators offered 83% of eligible patients with activation assistance. Sixty-four percent of the patients (n=1062) offered MyChart enrollment assistance accepted help. Seventy-four percent of assisted patients with no prior MyChart enrollment activated their accounts during that clinic visit. The primary reason for declining MyChart assistance was a lack of access to or comfort with technology. Patient portal activation increased during the 8 months when navigators were at the clinics (51%) compared to the previous 8 months (44%). Most new users viewed lab results and read a message [χ2(1)=49.3, p<.001], with significant increases evident for African Americans [44% before, 49% during; χ2(1)=40.4, p<.001] and Latinx patients [52% before, 60% during; χ2(1)=6.15, p=.013].

Conclusion

Study results suggest that using patient navigators is feasible and beneficial for increasing patient enrollment in the Federally Qualified Health Centers context. However, patient-, clinic-, and system-level factors were identified as barriers and should be addressed in future research studies.

Use of the patient portal among older adults with diagnosed dementia and their care partners

INTRODUCTION

Care partners are at the forefront of dementia care, yet little is known about patient portal use in the context of dementia diagnosis.

METHODS

We conducted an observational cohort study of date/time-stamped patient portal use for a 5-year period (October 3, 2017-October 2, 2022) at an academic health system. The cohort consisted of 3170 patients ages 65+ with diagnosed dementia with 2+ visits within 24 months. Message authorship was determined by manual review of 970 threads involving 3065 messages for 279 patients.

RESULTS

Most (71.20%) older adults with diagnosed dementia were registered portal users but far fewer (10.41%) had a registered care partner with shared access. Care partners authored most (612/970, 63.09%) message threads, overwhelmingly using patient identity credentials (271/279, 97.13%).

DISCUSSION

The patient portal is used by persons with dementia and their care partners. Organizational efforts that facilitate shared access may benefit the support of persons with dementia and their care partners. Highlights Patient portal registration and use has been increasing among persons with diagnosed dementia. Two thirds of secure messages from portal accounts of patients with diagnosed dementia were identified as being authored by care partners, primarily using patient login credentials. Care partners who accessed the patient portal using their own identity credentials through shared access demonstrate similar levels of activity to patients without dementia. Organizational initiatives should recognize and support the needs of persons with dementia and their care partners by encouraging awareness, registration, and use of proper identity credentials, including shared, or proxy, portal access.

Engaging and informing patients: Health information technology use in community health centers

OBJECTIVE

This paper aims to address the relationship between the community health center (CHC) patient mix and the level of patient engagement health information technology (HIT) comprehensiveness.

PARTICIPANTS

The study was conducted on sample CHCs (n = 3,592 CHC-years) active between 2016 and 2018.

METHODS

Patient engagement HIT comprehensiveness was measured based on a framework of patient engagement through HIT that includes a two-part dichotomy of patient engagement and patient informing. Univariate analysis was used to describe CHC characteristics and multivariable ordered logistic regression analysis was used to test hypothesized relationships.

RESULTS

The study identified four levels of patient engagement HIT comprehensiveness: 1) to neither engage nor inform, 2) to primarily inform, 3) to primarily engage, and 4) to engage and inform. It was found that CHCs serving disproportionate shares of patients with disadvantageous socioeconomic characteristics are less likely to incorporate more comprehensive patient engagement HIT.

CONCLUSION

The results highlight the different levels of patient engagement HIT use among CHCs and a negative association between CHC's higher proportion of patients with a disadvantageous sociodemographic background and patient engagement HIT comprehensiveness.

The Positive Effect of an Online Appointment Portal on a Breast Cancer Screening Program

BACKGROUND

The adoption of web-based appointment methods by health care systems is increasing.

OBJECTIVES

This study primarily aimed to evaluate in the setting of an organized breast cancer screening program the actual usage of an online appointment portal by the target population, i.e., how the online tool was used (type and timing of the actions performed) and by whom (users' characteristics); the effect of coronavirus disease 2019 (COVID-19) on its usage was also investigated. The effect of adopting this tool on the attendance to breast cancer screening was contextually investigated.

METHODS

Electronic data records of 75,903 women (45-74 years old, residing in the territory of Bologna Local Health Authority) were retrospectively reviewed.

RESULTS

In total, 12.4% of women logged into the online portal at least once. Most of them (79.9%) rescheduled, 15.7% viewed, and 4.4% cancelled their own appointment. In addition, 40.6% of all rescheduling actions were performed by the online portal; the remaining was performed by the toll-free number/dedicated email address. The highest peak (13.8%) of web accesses was registered at 10 a.m. Monday to Friday, when the toll-free number service is available. Percentages of portal usage were higher: (1) among the younger women, of Italian nationality, and for the first time invited to mammographic screening (p < 0.0001), and (2) in the pandemic period versus the prepandemic period (12.5 vs. 8.6%, respectively; p < 0.001). Finally, when compared to not using, the online portal usage led to an overall reduction in the no-show rate of almost 20% (p < 0.0001).

CONCLUSION

The action mainly performed by using the online appointment portal was the appointment rescheduling. The usage of this tool had a positive effect on the no-show rate and it can be speculated that has led to a reduction of the request load to be handled by the center's screening staff. Finally, this study confirmed that the COVID-19 pandemic boosted the use of digital technologies.

Baseline eHealth Behaviors of Service Members: A Retrospective, Cross-Sectional Analysis of Patient Portal Use Before the Pandemic

INTRODUCTION

The use of electronic health (eHealth) tools has the potential to support the overall health, wellness, fitness status, and ability to deploy worldwide of active duty service members (SMs). Additionally, the Coronavirus Disease 2019 pandemic forced healthcare organizations to quickly convert to virtual care settings to decrease face-to-face interactions and increase access to healthcare using technology. The shift to virtual care and the push to increase use of eHealth tools heightened the need to understand how military members interact with eHealth tools. Little is known about the factors that influence SMs use of eHealth tools and if having a health condition increases or decreases use. To evaluate these factors, we completed a cross-sectional, retrospective analysis on a sample of 198,388 active duty SMs aged 18 to 68 years.

MATERIALS AND METHODS

We used two Military Health System (MHS) data sources-Tricare Online (TOL) Patient Portal 2018 audit logs and outpatient electronic health record data. Using eHealth behaviors identified in the audit logs, we evaluated and compared individual characteristics (i.e., "gender", "age", "race", and "marital status"), environmental factors (i.e., "rank", "military branch", and "geographic location"), and six available health conditions (i.e., congenital health defects, amputation, anxiety, sleep, traumatic brain injury, and depression). Since moderate usage of eHealth tools is linked to improved health outcomes, adherence, communication, and increased consumer satisfaction, a logistic regression model was developed to find the factors most associated with moderate (3-11 logins per year) use of the portal.

RESULTS

Electronic health use increased by SMs with underlying health conditions or if they were managing family member health. Most SMs who used the TOL Patient Portal were of ages 25-34 years, White, and married. The mean age is 32.53 for males and 29.98 for females. Over half of the TOL Patient Portal SM users utilized the portal one to two times. Most SMs used the TOL Patient Portal in Virginia, Texas, California, Florida, North Carolina, Georgia, and Maryland. The highest use was during the months of March to May. Frequent patient portal actions include searching for appointments, viewing health information, viewing medical encounters, and refilling medications. Although SMs with congenital health defects, anxiety, sleep issues, and depression have higher patient portal use rates, SMs with depression have a negative association with using the patient portal at a "moderate" rate. Viewing family member health information and searching for appointments were strongly associated with patient portal moderate use.

CONCLUSIONS

Our findings support top military initiatives to improve the overall health, wellness, and readiness of SMs while decreasing the MHS's overall cost of care while providing a foundation to compare "pre" and "post" pandemic eHealth behaviors. It is essential to note that SMs are more likely to use a patient portal to seek information or manage family member health. This key factor identifies the significance of family health promotion and readiness in the active duty SM's life. The long-term goal of our study is to build the foundation for delivering tailored health information and eHealth tools to promote health and readiness-centric patient engagement.

Digital healthcare equity in primary care: implementing an integrated digital health navigator

The 21st Century Cures Act and the rise of telemedicine led to renewed focus on patient portals. However, portal use disparities persist and are in part driven by limited digital literacy. To address digital disparities in primary care, we implemented an integrated digital health navigator program supporting portal use among patients with type II diabetes. During our pilot, we were able to enroll 121 (30.9%) patients onto the portal. Of newly enrolled or trained patients, 75 (62.0%) were Black, 13 (10.7%) were White, 23 (19.0%) were Hispanic/Latinx, 4 (3.3%) were Asian, 3 (2.5%) were of another race or ethnicity, and 3 (2.5%) had missing data. Our overall portal enrollment for clinic patients with type II diabetes increased for Hispanic/Latinx patients from 30% to 42% and Black patients from 49% to 61%. We used the Consolidated Framework for Implementation Research to understand key implementation components. Using our approach, other clinics can implement an integrated digital health navigator to support patient portal use.

Parsley Health: Feasibility and acceptability of a large-scale holistic telehealth program for chronic disease care

Background

A holistic, personalized approach to medicine can be used to prevent and manage a variety of chronic diseases. However, effectively managing chronic diseases can be difficult due to barriers related to insufficient provider time, staffing, and lack of patient engagement. To address these challenges telehealth strategies are being increasingly adopted, yet few studies have explored how to evaluate the feasibility and implementation success of large-scale holistic telehealth models for chronic disease care. The aim of this study is to assess the feasibility and acceptability of a large-scale holistic telehealth program for the management of chronic diseases. Our study findings can inform the future development and assessment of chronic disease programs delivered through telehealth strategies.

Methods

Data was collected from participants enrolled in a Parsley Health membership from June 1, 2021 to June 1, 2022, a subscription-based holistic medicine practice designed to help people prevent or manage chronic diseases. Implementation outcome frameworks were used to understand engagement with services, participant satisfaction, and preliminary effectiveness of the program via a patient-reported symptom severity tool.

Results

Data from 10,205 participants with a range of chronic diseases were included in our analysis. Participants averaged 4.8 visits with their clinical team and reported high levels of satisfaction with their care (average NPS score of 81.35%). Preliminary evidence also showed substantial reduction in patient reported symptom severity.

Conclusion

Our findings suggest the Parsley Health program is a feasible and acceptable large-scale holistic telehealth program for chronic disease care. Successful implementation was due, in part, to services that promoted participant engagement along with tools and interfaces that were helpful and easy to use. These findings can be used to develop future holistic-focused telehealth programs for the management and prevention of chronic diseases.

A systematic review of the effectiveness of patient education through patient portals

Objective

The objective of this study was to systematically review all literature studying the effect of patient education on patient engagement through patient portals.

Introduction

Patient portals provide patients access to health records, lab results, medication refills, educational materials, secure messaging, appointment scheduling, and telehealth visits, allowing patients to take a more active role in their health care decisions and management. A debate remains around whether these additional aids actually improve patient engagement and increase their ability to manage their own health conditions. This systematic review looks specifically at the effect of educational materials included in patient portals.

Materials and Methods

In accordance with PRISMA guidelines, the literature search was mapped across 5 databases (PubMed, CINAHL, Scopus, PsychINFO, Embase), and implemented on June 2, 2020.

Results

Fifty-two studies were included in the review. Forty-six (88.5%) reported rates of patient utilization of educational resources in the patient portal. Thirty (57.9%) shared patients' perceptions of the usefulness of the education materials. Twenty-one (40.4%) reported changes in health outcomes following educational interventions through the patient portal. This review found that efforts are indeed being made to raise awareness of educational resources in patient portals, that patients are increasingly utilizing these resources, that patients are finding them useful, and that they are improving health outcomes.

Conclusion

It seems that patient portals are becoming a powerful tool for patient education and engagement, and show promise as a means of achieving the quadruple aim of healthcare. Moving forward, research should establish more uniform methods of measurement in order to strengthen the literature surrounding the effectiveness of patient education through patient portals.

The Use of a Technology Acceptance Model (TAM) to Predict Patients' Usage of a Personal Health Record System: The Role of Security, Privacy, and Usability

Personal health records (PHR) systems are designed to ensure that individuals have access and control over their health information and to support them in being active participants rather than passive ones in their healthcare process. Yet, PHR systems have not yet been widely adopted or used by consumers despite their benefits. For these advantages to be realized, adoption of the system is necessary. In this study, we examined how self-determination of health management influences individuals' intention to implement a PHR system, i.e., their ability to actively manage their health. Using an extended technology acceptance model (TAM), the researchers developed and empirically tested a model explaining public adoption of PHRs. In total, 389 Saudi Arabian respondents were surveyed in a quantitative cross-sectional design. The hypotheses were analysed using structural equation modelling-partial least squares (SEM-PLS4). Results indicate that PHR system usage was influenced by three major factors: perceived ease of use (PEOU), perceived usefulness (PU), and security towards intention to use. PHR PEOU and PHR intention to use were also found to be moderated by privacy, whereas usability positively moderated PHR PEOU and PHR intention to use and negatively moderated PHR PU and PHR intention to use. For the first time, this study examined the use of personal health records in Saudi Arabia, including the extension of the TAM model as well as development of a context-driven model that examines the relationship between privacy, security, usability, and the use of PHRs. Furthermore, this study fills a gap in the literature regarding the moderating effects of privacy influence on PEOU and intention to use. Further, the moderating effects of usability on the relationship between PEOU, PU, and intention to use. Study findings are expected to assist government agencies, health policymakers, and health organizations around the world, including Saudi Arabia, in understanding the adoption of personal health records.

Patterns of Health Portal Use by Regular Portal Users Among Patients With Cancer: Results From the UWCCC Survivorship Program

PURPOSE

We sought to evaluate the patterns of portal usage among patients with cancer who regularly log in to the portal. These data will inform approaches to facilitate portal use among patients with cancer.

PATIENTS AND METHODS

We conducted a retrospective analysis of patient portal usage by patients with cancer at the University of Wisconsin Carbone Cancer Center. Our analysis focuses on patterns of portal use by regular users (≥ 2 portal logins/year, > 3 months) receiving ongoing oncology care between January 1, 2017, and December 31, 2019. Demographics, cancer characteristics, number of oncology visits per month, and portal usage data were extracted. Regular portal users were grouped and compared on the basis of their frequency of use. A linear mixed-effects model was used to determine if the frequency of oncology visits influenced the number of logins.

RESULTS

We identified 2076 regular portal users. The median number of portal logins/year was 72 for the entire cohort. Age and race were associated with frequency of portal logins. There was no difference in frequency of portal login on the basis of cancer type or stage. Each additional oncology office visit in a month increased the frequency of portal logins by 3.05 ± 0.11 (SE) within the same month. Messages and test result functionalities were used by 98.7% and 98.9% of the regular users, respectively. Regular users who logged in to portal more frequently used all five studied portal functionalities.

CONCLUSION

Patients with cancer who use portals regularly use it more in proximity to an oncology office visit and use multiple available portal functionalities. These findings can direct strategic planning to facilitate portal utilization among those not engaged with this tool.

Characteristics of Adult Primary Care Patients Who Use the Patient Portal: A Cross-Sectional Analysis

BACKGROUND

The patient portal allows patients to engage with their health care team beyond the clinical encounter. While portals can improve patient outcomes, there may be disparities in which patients access the portal by sociodemographic factors. Understanding the characteristics of patients who use the portal could help design future interventions to expand portal adoption.

OBJECTIVES

This study aimed to (1) examine the socioeconomic factors, comorbid conditions, and health care utilization among patients of a large academic primary care network who are users and non-users of the patient portal; and (2) describe the portal functions most frequently utilized.

METHODS

We included all adult patients at Atrium Health Wake Forest Baptist who had at least two primary care visits between 2018 and 2019. Patients' demographics, comorbidities, health care utilization, and portal function usage were extracted from the electronic health record and merged with census data (income, education, and unemployment) from the American Community Survey. A myWakeHealth portal user was defined as a patient who used a bidirectional portal function at least once during the study period. We used multivariable logistic regression to determine which patient characteristics were independently associated with being a portal user.

RESULTS

Of the 178,720 patients who met inclusion criteria, 32% (N = 57,122) were users of myWakeHealth. Compared to non-users, users were more likely to be 18 to 64 years of age, female, non-Hispanic White, married, commercially insured, have higher disease burden, and have lower health care utilization. Patients residing in areas with the highest educational attainment had 51% higher odds of being a portal user than the lowest (p <0.001). Among portal users, the most commonly used function was messaging clinic providers.

CONCLUSION

We found that patient demographics and area socioeconomic factors were associated with patient portal adoption. These findings suggest that efforts to improve portal adoption should be targeted at vulnerable patients.

Experiences of care coordination among older adults in the United States: Evidence from the Health and Retirement Study

INTRODUCTION

The goal of this study was to examine variation in patient experiences and perceptions of care coordination across sociodemographic and health factors.

METHODS

Data come from the 2016 Health and Retirement Study (N = 1, 216). Three domains of coordination were assessed: 1) Perceptions (e.g., patient impressions of provider-provider communication), 2) Tangible supports (e.g., meeting with a care coordinator, being accompanied to appointments), and 3) Technical supports (e.g., use of a "patient portal"). Logistic regression was used to quantify the frequency of each domain and examine variation by racial minority status, socioeconomic status, and health status.

RESULTS

Approximately 42% of older adults perceived poor care coordination, including 14.8% who reported receiving seemingly conflicting advice from different providers. Only one-third had ever met with a formal care coordinator, and 40% were occasionally accompanied to appointments. Although racial minorities were less likely to have access to technical supports, they were more likely to use them. Better perceived coordination was associated with higher care satisfaction (Odds Ratio: 1.43, 95% CI: 1.27-1.61).

CONCLUSIONS

Important gaps in care coordination remain for older adults.

PRACTICE IMPLICATIONS

Providers should consider assessing patient perceptions of care coordination to address these gaps in an equitable manner.

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi Approach (TED)

Background

Patient portals have been introduced in many countries over the last 10 years, but many health information managers still feel they have too little knowledge of patient portals. A taxonomy can help them to better compare and select portals. This has led us to develop the TOPCOP taxonomy for classifying and comparing patient portals. However, the taxonomy has not been evaluated by users.

Objective

This study aimed to evaluate the taxonomy’s usefulness to support health information managers in comparing, classifying, defining a requirement profile for, and selecting patient portals and to improve the taxonomy where needed.

Methods

We used a modified Delphi approach. We sampled a heterogeneous panel of 13 health information managers from 3 countries using the criterion sampling strategy. We conducted 4 anonymous survey rounds with qualitative and quantitative questions. In round 1, the panelists assessed the appropriateness of each dimension, and we collected new ideas to improve the dimensions. In rounds 2 and 3, the panelists iteratively evaluated the taxonomy that was revised based on round 1. In round 4, the panelists assessed the need for a taxonomy and the appropriateness of patient engagement as a distinguishing concept. Then, they compared 2 real portals with the final taxonomy and evaluated its usefulness for comparing portals, creating an initial requirement profile, and selecting patient portals. To determine group consensus, we applied the RAND/UCLA Appropriateness Method.

Results

The final taxonomy consists of 25 dimensions with 65 characteristics. Five new dimensions were added to the original taxonomy, with 8 characteristics added to already existing dimensions. Group consensus was achieved on the need for such a taxonomy to compare portals, on patient engagement as an appropriate distinguishing concept, and on the comprehensibility of the taxonomy’s form. Further, consensus was achieved on the taxonomy’s usefulness for classifying and comparing portals, assisting users in better understanding portals, creating a requirement profile, and selecting portals. This allowed us to test the usefulness of the final taxonomy with the intended users.

Conclusions

The TOPCOP taxonomy aims to support health information managers in comparing and selecting patient portals. By providing a standardized terminology to describe various aspects of patient portals independent of clinical setting or country, the taxonomy will also be useful for advancing research and evaluation of patient portals.