Patient Perceptions of Receiving COVID-19 Test Results via an Online Patient Portal: An Open Results Survey

Preferences of Pediatric Oncology Patients and Caregivers on the Availability of Patient Results in an Online Patient Portal

PURPOSE

Access to cancer-related data in online patient portals is not uniform. Perspectives of pediatric patients with cancer and caregivers on their desires and experiences accessing cancer-related data via an online patient portal have been poorly described. These perspectives are crucial for informing both hospital-level policies and governmental regulations. This study aims to explore the preferences of pediatric oncology patients and their caregivers regarding the timing of medical test result release into online portals.

METHODS

A cross-sectional survey was conducted at a tertiary academic pediatric center in Toronto, Canada. English-speaking pediatric patients with cancer age 12 years and older, as well as their caregivers, were invited to participate. A 59-question survey was administered to participants between June and August 2024.

RESULTS

A total of 105 participants, including 40 patients and 65 caregivers, completed the survey. Forty-one (53.9%) participants reported that a health care provider had discussed with them the possibility that they might be viewing test results online before their care team had reviewed the result. Immediate release of test results was preferred across most testing domains, with >80% of participants favoring immediate access, even for sensitive oncology-related results. Less than 1% of participants believed that genetic or cancer recurrence results should be withheld until reviewed by an oncology provider. No participants reported increased worry as a result of viewing test results online.

CONCLUSION

This study reveals a strong preference among pediatric oncology patients and their caregivers for immediate access to test results, challenging traditional concerns about the psychological impact of early release. These findings suggest that oncology practices should consider aligning their policies with patient and caregiver preferences.

A proof-of-concept study for patient use of open notes with large language models

Objectives

The use of large language models (LLMs) is growing for both clinicians and patients. While researchers and clinicians have explored LLMs to manage patient portal messages and reduce burnout, there is less documentation about how patients use these tools to understand clinical notes and inform decision-making. This proof-of-concept study examined the reliability and accuracy of LLMs in responding to patient queries based on an open visit note.

Materials and Methods

In a cross-sectional proof-of-concept study, 3 commercially available LLMs (ChatGPT 4o, Claude 3 Opus, Gemini 1.5) were evaluated using 4 distinct prompt series-Standard, Randomized, Persona, and Randomized Persona-with multiple questions, designed by patients, in response to a single neuro-oncology progress note. LLM responses were scored by the note author (neuro-oncologist) and a patient who receives care from the note author, using an 8-criterion rubric that assessed Accuracy, Relevance, Clarity, Actionability, Empathy/Tone, Completeness, Evidence, and Consistency. Descriptive statistics were used to summarize the performance of each LLM across all prompts.

Results

Overall, the Standard and Persona-based prompt series yielded the best results across all criterion regardless of LLM. Chat-GPT 4o using Persona-based prompts scored highest in all categories. All LLMs scored low in the use of Evidence.

Discussion

This proof-of-concept study highlighted the potential for LLMs to assist patients in interpreting open notes. The most effective LLM responses were achieved by applying Persona-style prompts to a patient's question.

Conclusion

Optimizing LLMs for patient-driven queries, and patient education and counseling around the use of LLMs, have potential to enhance patient use and understanding of their health information.

Repeated Access to Patient Portal While Awaiting Test Results and Patient-Initiated Messaging

Importance

Patients have immediate access to test results in the patient portal, which can cause worry. Identifying behaviors associated with worry while awaiting results may allow health systems to support patients and reduce message volumes.

Objective

To describe characteristics of patients who refresh their portal while awaiting test results and measure the association between refresh behavior and patient-initiated messaging.

Design, Setting, and Participants

This retrospective cross-sectional study was performed at Vanderbilt University Medical Center, which uses a MyChart-based patient portal. All adult patients (aged ≥18 years) who received outpatient test results between January 1, 2022, and December 31, 2023, were included.

Exposures

Use of the patient portal to review test results.

Main Outcomes and Measures

The primary outcome was the proportion of patients who refreshed the portal while awaiting test results. Tests were stratified into low-sensitivity (eg, basic metabolic panel) and high-sensitivity (eg, tissue biopsy) groups using validated categories based on each test's likelihood of being misinterpreted or causing distress. Portal access logs were used to identify refresh behaviors, in which patients accessed the portal seeking new results. Secondary outcomes included the association between patient characteristics and refresh behavior and between refresh behavior and messaging as measured using multivariable logistic regression.

Results

A total of 968 774 results were reviewed by 290 349 patients (mean [SD] age, 47.8 [18.0] years; 66.3% female). Patients refreshed their portal for 25.9% of results. Patients more commonly refreshed for high-sensitivity results (25 280 of 64 356 [39.3%]) compared with low sensitivity results (225 516 of 904 418 [24.9%]) (P < .001). Patients who enabled notifications had higher odds of refreshing for high-sensitivity results (odds ratio, 1.11; 95% CI, 1.06-1.17) and low-sensitivity results (odds ratio, 1.54; 95% CI, 1.49-1.59). Each refresh for high-sensitivity results was associated with a lower increase in the probability of messaging within 24 hours (mean marginal effect, 0.41; 95% CI, 0.34-0.49) compared with refreshing for low-sensitivity results (mean marginal effect, 1.03; 95% CI, 0.96-1.11).

Conclusion and Relevance

This cross-sectional study found an association of patients' refresh activity for low-sensitivity results with patient-initiated messaging after review. These findings suggest that refresh behavior, a potential measure of worry, may be a characteristic of patient attitudes and preferences rather than the test.

Patient and Family Perceptions of Real-Time Access to Electronic Health Information: A Social Media Survey

OBJECTIVE

 This study seeks to understand pediatric rheumatology patients' and caregivers' utilization and perceptions of immediate access to their electronic health information (EHI) via patient portals.

METHODS

 An anonymous, 23-question Qualtrics survey was distributed via social media to patients and families with pediatric rheumatic diseases. The survey link and Quick Response (QR) code were posted on disease-specific Facebook accounts. Descriptive statistics were used with a thematic content analysis performed on free-text responses.

RESULTS

 The survey received 253 eligible responses. Nearly 48% of participants reported accessing their electronic patient portal >12 times in the last year, while only 0.4% (one respondent) reported accessing it zero times and 8% reported accessing it 1 to 2 times. Following a medical appointment, 45% reported regularly accessing their portal the same day as their appointment, 36% when they get an alert for new results, and 0.8% only in response to a healthcare provider message. About 98% use the patient portal to access laboratory results, 98% provider notes, 80% healthcare provider messages, 64% imaging results, 53% appointments, and 28% medications. Thematic content analysis found that respondents use the portal for coordination of care and to advocate for themselves or their child. The emotional impact of access to EHI without provider explanation was variable by respondent, with some reporting increased worry and some less worry. Many respondents (18%) found value in posting results to social media sites for help in interpretation.

CONCLUSION

 This study demonstrates pediatric rheumatology patients' and caregivers' strong portal engagement and expectation for immediate access to EHI through the patient portal. Although some did report that access to EHI without provider input can increase worry or anxiety, families perceive the patient portal as a tool for self-advocacy and engagement in care, leading to a stronger sense of their role as a member of the care team.

When Bad News Comes Through the Portal: Strengthening Trust and Guiding Patients When They Receive Bad Results Before Their Clinicians

Communication in oncology was challenging long before the emergence of the US 21st Century Cures Act. Before 2021, a growing body of evidence had demonstrated the benefits of patients' access to and review of the clinical notes in their charts (open notes); however, studies examining the benefits of immediate access to test results were scarce until the implementation of the Cures Act's Information Blocking Rule. Individuals grappling with cancer today now possess immediate access to their laboratory results, imaging scans, diagnostic tests, and progress notes as mandated by law. To many clinicians, the implementation of the Cures Act felt sudden and presented new challenges and concerns for oncologists surrounding patients' potential emotional reactions to medical notes or lack of control over the careful delivery of potentially life-changing information. Despite data that show most patients want immediate access to information in their records before it is communicated directly by a health care professional, surveys of oncologists showed trepidation. In this chapter, perspectives from a patient with cancer, an oncologist, and a cancer psychiatrist (in that order) are shared to illuminate the adjustments made in clinician-patient communication amid the era of nearly instantaneous results within the electronic health record.

Real-Time Electronic Patient Portal Use Among Emergency Department Patients

Importance

Patients with inequitable access to patient portals frequently present to emergency departments (EDs) for care. Little is known about portal use patterns among ED patients.

Objectives

To describe real-time patient portal usage trends among ED patients and compare demographic and clinical characteristics between portal users and nonusers.

Design, Setting, and Participants

In this cross-sectional study of 12 teaching and 24 academic-affiliated EDs from 8 health systems in California, Connecticut, Massachusetts, Ohio, Tennessee, Texas, and Washington, patient portal access and usage data were evaluated for all ED patients 18 years or older between April 5, 2021, and April 4, 2022.

Exposure

Use of the patient portal during ED visit.

Main Outcomes and Measures

The primary outcomes were the weekly proportions of ED patients who logged into the portal, viewed test results, and viewed clinical notes in real time. Pooled random-effects models were used to evaluate temporal trends and demographic and clinical characteristics associated with real-time portal use.

Results

The study included 1 280 924 unique patient encounters (53.5% female; 0.6% American Indian or Alaska Native, 3.7% Asian, 18.0% Black, 10.7% Hispanic, 0.4% Native Hawaiian or Pacific Islander, 66.5% White, 10.0% other race, and 4.0% with missing race or ethnicity; 91.2% English-speaking patients; mean [SD] age, 51.9 [19.2] years). During the study, 17.4% of patients logged into the portal while in the ED, whereas 14.1% viewed test results and 2.5% viewed clinical notes. The odds of accessing the portal (odds ratio [OR], 1.36; 95% CI, 1.19-1.56), viewing test results (OR, 1.63; 95% CI, 1.30-2.04), and viewing clinical notes (OR, 1.60; 95% CI, 1.19-2.15) were higher at the end of the study vs the beginning. Patients with active portal accounts at ED arrival had a higher odds of logging into the portal (OR, 17.73; 95% CI, 9.37-33.56), viewing test results (OR, 18.50; 95% CI, 9.62-35.57), and viewing clinical notes (OR, 18.40; 95% CI, 10.31-32.86). Patients who were male, Black, or without commercial insurance had lower odds of logging into the portal, viewing results, and viewing clinical notes.

Conclusions and Relevance

These findings suggest that real-time patient portal use during ED encounters has increased over time, but disparities exist in portal access that mirror trends in portal usage more generally. Given emergency medicine's role in caring for medically underserved patients, there are opportunities for EDs to enroll and train patients in using patient portals to promote engagement during and after their visits.

Shifting Mindsets: The Impact of a Patient Portal on Functioning and Recovery in a Mental Health Setting

OBJECTIVE

This study aims to understand whether higher use of a patient portal can have an impact on mental health functioning and recovery.

METHOD

A mixed methods approach was used for this study. In 2019-2021, patients with mental health diagnoses at outpatient clinics in an academic centre were invited to complete World Health Organization Disability Assessment Scale 12 (WHODAS-12) and Mental Health Recovery Measure surveys at baseline, 3 months, and 6 months after signing up for the portal. At the 3-month time point, patients were invited to a semistructured interview with a member of the team to contextualize the findings obtained from the surveys. Analytics data was also collected from the platform to understand usage patterns on the portal.

RESULTS

Overall, 113 participants were included in the analysis. There was no significant change in mental health functioning and recovery scores over the 6-month period. However, suboptimal usage was observed as 46% of participants did not complete any tasks within the portal. Thirty-five participants had low use of the portal (1-9 interactions) and 18 participants had high usage (10+ interactions). There were also no differences in mental health functioning and recovery scores between low and high users of the portal. Qualitative interviews highlighted many opportunities where the portal can support overall functioning and mental health recovery.

CONCLUSIONS

Collectively, this study suggests that higher use of a portal had no impact, either positive or negative, on mental health outcomes. While it may offer convenience and improved patient satisfaction, adequate support is needed to fully enable these opportunities for patient care. As the type of interaction with the portal was not specifically addressed, future work should focus on looking at ways to support patient engagement and portal usage throughout their care journey.

Patient Portal Enrollment for Discharged Pediatric Emergency Department Patients: A Multidisciplinary Quality Improvement Project

Introduction

Patient portal enrollment following pediatric emergency department (ED) visits allows access to critical results, physician documentation, and telehealth follow-up options. Despite these advantages, there are many challenges to portal invitation and enrollment. Our primary objective was to improve patient portal enrollment rates for discharged pediatric ED patients.

Methods

A multidisciplinary team of staff from two ED sites developed successful portal enrollment interventions through sequential Plan-Do-Study-Act cycles from October 2020 to October 2021. Interventions included a new invitation process, changes to patient paperwork on ED arrival, staff portal education, and changes to discharge paperwork and the portal website. The team utilized statistical process control charts to track the percentage of eligible discharged patients who received a portal invitation (process measure) and enrolled in the patient portal.

Results

Before the study's initiation, less than 1% of eligible patients received patient portal invites or enrolled in the patient portal. Statistical process control charts revealed significant changes in enrollment and baseline shift at both a large academic ED campus and a satellite ED site by May 2021. Improvements in invitation rates were also observed at both campuses. Changes were sustained for over 6 months at both locations.

Conclusions

High-reliability interventions and a multidisciplinary approach allowed for significant and sustained improvement in patient portal invitation and enrollment rates in eligible pediatric ED patients. Future study will examine enrollment patterns across patient demographics and further high-reliability interventions.

Disparities in Patient Portal Use Among Adults With Chronic Conditions

Importance

Disparities in patient access and use of health care portals have been documented. Limited research has evaluated disparities in portal use during and after the COVID-19 pandemic.

Objective

To assess prevalence of health care portal use before, during, and after the most restrictive phase of the pandemic (2019-2022) among the COVID-19 & Chronic Conditions (C3) cohort and to investigate any disparities in use by sociodemographic factors.

Design, Setting, and Participants

This cohort study uses data from the C3 study, an ongoing, longitudinal, telephone-based survey of participants with multiple chronic conditions. Participants were middle aged and older-adult primary care patients who had an active portal account, recruited from a single academic medical center in Chicago, Illinois, between 2019 and 2022. Data were analyzed between March and June 2022.

Main Outcomes and Measures

Outcomes of portal use (ie, number of days of portal login by year) were recorded for all study participants by the electronic data warehouse. All parent studies had uniform sociodemographic data and measures of social support, self-efficacy, health literacy, and health activation.

Results

Of 536 participants (mean [SD] age, 66.7 [12.0] years; 336 [62.7%] female), 44 (8.2%) were Hispanic or Latinx, 142 (26.5%) were non-Hispanic Black, 322 (60.1%) were non-Hispanic White, and 20 individuals (3.7%) identified as other race, including Asian, Native American or Alaskan Native, and self-reported other race. In multivariable analyses, portal login activity was higher during the 3 years of the COVID-19 pandemic compared with the 2019 baseline. Higher portal login activity was associated with adequate health literacy (incidence rate ratio [IRR], 1.51; 95% CI, 1.18-1.94) and multimorbidity (IRR, 1.38; 95% CI, 1.17-1.64). Lower portal activity was associated with older age (≥70 years: IRR, 0.69; 95% CI, 0.55-0.85) and female sex (IRR, 0.77; 95% CI, 0.66-0.91). Compared with non-Hispanic White patients, lower portal activity was observed among Hispanic or Latinx patients (IRR, 0.66; 95% CI, 0.49-0.89), non-Hispanic Black patients (IRR, 0.68; 95% CI, 0.56-0.83), and patients who identified as other race (IRR, 0.42; 95% CI, 0.28-0.64).

Conclusions and Relevance

This cohort study using data from the C3 study identified changes in portal use over time and highlighted populations that had lower access to health information. The COVID-19 pandemic was associated with an increase in portal use. Sociodemographic disparities by sex and age were reduced, although disparities by health literacy widened. A brief validated health literacy measure may serve as a useful digital literacy screening tool to identify patients who need further support.

The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating

BACKGROUND AND OBJECTIVE

Recent external factors-the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic-have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals.

METHODS

To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses.

RESULTS

Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities).

CONCLUSION

Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

Impact of a switch to immediate release on the patient viewing of diagnostic test results in an online portal at an academic medical center

Patient portals allow patients to access their personal health information. The 21st Century Cures Act in the United States sought to eliminate 'information blocking', requiring timely release upon request of electronic health information including diagnostic test results. Some health systems, including the one in the present study, chose a systematic switch to immediate release of all or nearly all diagnostic test results to patient portals as part of compliance with the Cures Act. Our primary objective was to study changes in the time to view test results by patients before and after implementation of Cures Act-related changes. This retrospective pre-post study included data from two 10-month time periods before and after implementation of Cures Act-related changes at an academic medical center. The study included all patients (adult and pediatric) with diagnostic testing (laboratory and imaging) performed in the outpatient, inpatient, or emergency department settings. Between February 9, 2020 and December 9, 2021, there was a total of 3 809 397 diagnostic tests from 204 605 unique patients (3 320 423 tests for adult patients; 488 974 for pediatric patients). Overall, 56.5% (115 627) of patients were female, 84.1% (172 048) white, and 96.5% (197 517) preferred English as primary language. The odds of viewing test results within 1 and 30 days after portal release increased monthly throughout both time periods before and after the Cures Act for all patients. The rate of increase was significantly higher after implementation only in the subgroup of tests belonging to adult patients with active MyChart accounts. Immediate release shifted a higher proportion of result/report release to weekends (3.2% pre-Cures vs 15.3% post-Cures), although patient viewing patterns by day of week and time of day were similar before and after immediate release changes. The switch to immediate release of diagnostic test results to the patient portal resulted in a higher fraction of results viewed within 1 day across outpatient, inpatient, and emergency department settings.

"I don't think it should take you three days to tell me my baby is dead." A case of fetal demise: unintended consequences of immediate release of information

The 21st Century Cures Act (Cures Act) information blocking regulations mandate timely patient access to their electronic health information. In most healthcare systems, this technically requires immediate electronic release of test results and clinical notes directly to patients. Patients could potentially be distressed by receiving upsetting results through an electronic portal rather than from a clinician. We present a case from 2018, several years prior to the implementation of the Cures Act. A patient was notified of fetal demise detected by ultrasound through her electronic health record (EHR) patient portal before her clinician received the result. We discuss the patient's ensuing complaint and healthcare system response. This unusual and dramatic case of fetal demise is relevant today because it underscores the importance of involving a patient and family advisory council in decision-making. It also highlights the value of "anticipatory guidance" as a routine clinical practice in this era of immediate access to test results.

Perspectives of Patients About Immediate Access to Test Results Through an Online Patient Portal

Importance

The 21st Century Cures Act Final Rule mandates the immediate electronic availability of test results to patients, likely empowering them to better manage their health. Concerns remain about unintended effects of releasing abnormal test results to patients.

Objective

To assess patient and caregiver attitudes and preferences related to receiving immediately released test results through an online patient portal.

Design, Setting, and Participants

This large, multisite survey study was conducted at 4 geographically distributed academic medical centers in the US using an instrument adapted from validated surveys. The survey was delivered in May 2022 to adult patients and care partners who had accessed test results via an online patient portal account between April 5, 2021, and April 4, 2022.

Exposures

Access to test results via a patient portal between April 5, 2021, and April 4, 2022.

Main Outcomes and Measures

Responses to questions related to demographics, test type and result, reaction to result, notification experience and future preferences, and effect on health and well-being were aggregated. To evaluate characteristics associated with patient worry, logistic regression and pooled random-effects models were used to assess level of worry as a function of whether test results were perceived by patients as normal or not normal and whether patients were precounseled.

Results

Of 43 380 surveys delivered, there were 8139 respondents (18.8%). Most respondents were female (5129 [63.0%]) and spoke English as their primary language (7690 [94.5%]). The median age was 64 years (IQR, 50-72 years). Most respondents (7520 of 7859 [95.7%]), including 2337 of 2453 individuals (95.3%) who received nonnormal results, preferred to immediately receive test results through the portal. Few respondents (411 of 5473 [7.5%]) reported that reviewing results before they were contacted by a health care practitioner increased worry, though increased worry was more common among respondents who received abnormal results (403 of 2442 [16.5%]) than those whose results were normal (294 of 5918 [5.0%]). The result of the pooled model for worry as a function of test result normality was statistically significant (odds ratio [OR], 2.71; 99% CI, 1.96-3.74), suggesting an association between worry and nonnormal results. The result of the pooled model evaluating the association between worry and precounseling was not significant (OR, 0.70; 99% CI, 0.31-1.59).

Conclusions and Relevance

In this multisite survey study of patient attitudes and preferences toward receiving immediately released test results via a patient portal, most respondents preferred to receive test results via the patient portal despite viewing results prior to discussion with a health care professional. This preference persisted among patients with nonnormal results.

eHealth Literacy and Patient Portal Use and Attitudes: Cross-sectional Observational Study

BACKGROUND

Throughout the COVID-19 pandemic, patient portals have become more widely used tools of patient care delivery. However, not all individuals have equivalent access or ability to use patient portals.

OBJECTIVE

The aim of this study is to evaluate the relationships between eHealth literacy (eHL) and patient portal awareness, use, and attitudes among hospitalized patients.

METHODS

Inpatients completed patient portal surveys; eHL was assessed (eHealth Literacy Scale). Multivariable logistic regression analyses adjusted for age, self-reported race, gender, and educational attainment were completed with significance at P<.006 (Bonferroni correction).

RESULTS

Among 274 participants, most identified as Black (n=166, 61%) and female (n=140, 51%), mean age was 56.5 (SD 16.7) years, and 178 (65%) reported some college or higher educational attainment. One-quarter (n=79, 28%) had low eHL (mean 27, SD 9.5), which was associated with lower odds of portal access awareness (odds ratio 0.11, 95% CI 0.05-0.23; P<.001), having ever used portals (odds ratio 0.19, 95% CI 0.10-0.36; P<.001), less perceived usefulness of portals (odds ratio 0.20, 95% CI 0.10-0.38; P=.001), and lower likelihood of planning to use portals in the coming years (odds ratio 0.12, 95% CI 0.06-0.25; P<.001). As time through the COVID-19 pandemic passed, there was a trend toward increased perceived usefulness of patient portals (53% vs 62%, P=.08), but average eHL did not increase through time (P=.81).

CONCLUSIONS

Low eHL was associated with less awareness, use, and perceived usefulness of portals. Perceived usefulness of portals likely increased through the COVID-19 pandemic, but patients' eHL did not. Interventions tailored for patients with low eHL could ensure greater equity in health care delivery through the COVID-19 pandemic.

Laboratory Results Release to Patients under the 21st Century Cures Act: The Eight Stakeholders Who Should Care

A major aim of the 21st Century Cures Act is to support patients' access to their electronic health data and to prevent information blocking practices by health care organizations and health information technology developers. Prior to the Cures Act, significant variation existed in patient access to laboratory test results, key pieces of health data which enable timely self-management and engagement in care. Although many health care systems began releasing test results immediately through patient portals because of the Cures Act, implementation remains challenging due to variations in state regulations around electronic results release, local interpretations of allowable exceptions to Cures information blocking, concerns about privacy of sensitive laboratory results, and technological limitations. This paper outlines the eight stakeholder groups involved in implementation of electronic laboratory result release to patients and describes recommendations for these groups to consider in achieving the Cures Act goals to support a patient's access to their health information and control of their health care.

Effect of Notes' Access and Complexity on OpenNotes' Utility

BACKGROUND

Health care providers are now required to provide their patients access to their consultation and progress notes. Early research of this concept, known as "OpenNotes," showed promising results in terms of provider acceptability and patient adoption, yet objective evaluations relating to patients' interactions with the notes are limited.

OBJECTIVES

To assess the effect of the complexity level of notes and number of accesses (initial read vs. continuous access) on the user's performance, perceived usability, cognitive workload, and satisfaction with the notes.

METHODS

We used a 2*2 mixed subjects experimental design with two independent variables: (1) note's complexity at two levels (simple vs. complex) and (2) number of accesses to notes at two levels (initial vs. continuous). Fifty-three participants were randomly assigned to receive a simple versus complex radiation oncology clinical note and were tested on their performance for understanding the note content after an initial read, and then with continuous access to the note. Performance was quantified by comparing each participant's answers to the ones developed by the research team and assigning a score of 0 to 100 based on participants' understanding of the notes. Usability, cognitive workload, and satisfaction scores of the notes were quantified using validated tools.

RESULTS

Performance for understanding was significantly better in simple versus complex notes with continuous access (p = 0.001). Continuous access to the notes was also positively associated with satisfaction scores (p = 0.03). The overall perceived usability, cognitive workload, and satisfaction scores were considered low for both simple and complex notes.

CONCLUSION

Simplifying notes can improve understanding of notes for patients/families. However, perceived usability, cognitive workload, and satisfaction with even the simplified notes were still low. To make notes more useful for patients and their families, there is a need for dramatic improvements to the overall usability and content of the notes.

Real-Time Patient Portal Use Among Emergency Department Patients: An Open Results Study

OBJECTIVES

We characterized real-time patient portal test result viewing among emergency department (ED) patients and described patient characteristics overall and among those not enrolled in the portal at ED arrival.

METHODS

Our observational study at an academic ED used portal log data to trend the proportion of adult patients who viewed results during their visit from May 04, 2021 to April 04, 2022. Correlation was assessed visually and with Kendall's τ. Covariate analysis using binary logistic regression assessed result(s) viewed as a function of time accounting for age, sex, ethnicity, race, language, insurance status, disposition, and social vulnerability index (SVI). A second model only included patients not enrolled in the portal at arrival. We used random forest imputation to account for missingness and Huber-White heteroskedasticity-robust standard errors for patients with multiple encounters (α = 0.05).

RESULTS

There were 60,314 ED encounters (31,164 unique patients). In 7,377 (12.2%) encounters, patients viewed results while still in the ED. Patients were not enrolled for portal use at arrival in 21,158 (35.2%) encounters, and 927 (4.4% of not enrolled, 1.5% overall) subsequently enrolled and viewed results in the ED. Visual inspection suggests an increasing proportion of patients who viewed results from roughly 5 to 15% over the study (Kendall's τ = 0.61 [p <0.0001]). Overall and not-enrolled models yielded concordance indices (C) of 0.68 and 0.72, respectively, with significant overall likelihood ratio χ 2 (p <0.0001). Time was independently associated with viewing results in both models after adjustment. Models revealed disparate use between age, race, ethnicity, SVI, sex, insurance status, and disposition groups.

CONCLUSION

We observed increased portal-based test result viewing among ED patients over the year since the 21st Century Cures act went into effect, even among those not enrolled at arrival. We observed disparities in those who viewed results.

Characteristics of Adult Primary Care Patients Who Use the Patient Portal: A Cross-Sectional Analysis

BACKGROUND

The patient portal allows patients to engage with their health care team beyond the clinical encounter. While portals can improve patient outcomes, there may be disparities in which patients access the portal by sociodemographic factors. Understanding the characteristics of patients who use the portal could help design future interventions to expand portal adoption.

OBJECTIVES

This study aimed to (1) examine the socioeconomic factors, comorbid conditions, and health care utilization among patients of a large academic primary care network who are users and non-users of the patient portal; and (2) describe the portal functions most frequently utilized.

METHODS

We included all adult patients at Atrium Health Wake Forest Baptist who had at least two primary care visits between 2018 and 2019. Patients' demographics, comorbidities, health care utilization, and portal function usage were extracted from the electronic health record and merged with census data (income, education, and unemployment) from the American Community Survey. A myWakeHealth portal user was defined as a patient who used a bidirectional portal function at least once during the study period. We used multivariable logistic regression to determine which patient characteristics were independently associated with being a portal user.

RESULTS

Of the 178,720 patients who met inclusion criteria, 32% (N = 57,122) were users of myWakeHealth. Compared to non-users, users were more likely to be 18 to 64 years of age, female, non-Hispanic White, married, commercially insured, have higher disease burden, and have lower health care utilization. Patients residing in areas with the highest educational attainment had 51% higher odds of being a portal user than the lowest (p <0.001). Among portal users, the most commonly used function was messaging clinic providers.

CONCLUSION

We found that patient demographics and area socioeconomic factors were associated with patient portal adoption. These findings suggest that efforts to improve portal adoption should be targeted at vulnerable patients.

Lessons Learned from OpenNotes Learning Mode and Subsequent Implementation across a Pediatric Health System

BACKGROUND

The 21st Century Cures Act has accelerated adoption of OpenNotes, providing new opportunities for patient and family engagement in their care. However, these regulations present new challenges, particularly for pediatric health systems aiming to improve information sharing while minimizing risks associated with adolescent confidentiality and safety.

OBJECTIVE

Describe lessons learned preparing for OpenNotes across a pediatric health system during a 4-month trial period (referred to as "Learning Mode") in which clinical notes were not shared by default but decision support was present describing the upcoming change and physicians could request feedback on complex cases from a multidisciplinary team.

METHODS

During Learning Mode (December 3, 2020-March 9, 2021), implementation included (1) educational text at the top of commonly used note types indicating that notes would soon be shared and providing guidance, (2) a new confidential note type, and (3) a mechanism for physicians to elicit feedback from a multidisciplinary OpenNotes working group for complex cases with questions related to OpenNotes. The working group reviewed lessons learned from this period, as well as implementation of OpenNotes from March 10, 2021 to June 30, 2021.

RESULTS

During Learning Mode, 779 confidential notes were written across the system. The working group provided feedback on 14 complex cases and also reviewed 7 randomly selected confidential notes. The proportion of physician notes shared with patients increased from 1.3% to 88.4% after default sharing of notes to the patient portal. Key lessons learned included (1) sensitive information was often present in autopopulated elements, differential diagnoses, and supervising physician note attestations; and (2) incorrect reasons were often selected by clinicians for withholding notes but this accuracy improved with new designs.

CONCLUSION

While OpenNotes provides an unprecedented opportunity to engage pediatric patients and their families, targeted education and electronic health record designs are needed to mitigate potential harms of inappropriate disclosures.